00000100:00100000:0.0F:1789130608.344988:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857763712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130608.345069:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130608.345126:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857763712 00000100:00100000:0.0:1789130608.345134:0:18931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857763712 00000100:00100000:0.0:1789130608.345193:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789130608.345203:0:18931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857763712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130608.345246:0:18931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789130608.345293:0:18931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857763712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130608.345301:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789130608.345349:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857763712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130608.346367:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cbff44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857763840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130608.346412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1789130608.346499:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857763840 00000100:00100000:1.0:1789130608.346511:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857763840 00000100:00100000:1.0:1789130608.346548:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789130608.346556:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857763840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130608.346579:0:17947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789130608.346644:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857763840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130608.346651:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789130608.346791:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cbff44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857763840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130608.348356:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857763968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130608.348414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130608.348495:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857763968 00000100:00100000:1.0:1789130608.348502:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857763968 00000100:00100000:1.0:1789130608.348553:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130608.348561:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876038857763968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130608.348592:0:19458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789130608.353364:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876038857763968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4789us (4935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130608.353382:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130608.358473:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857763968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789130608.606279:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130609.369109:0:17977:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789130609.369123:0:17977:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130609.369147:0:17977:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789130609.369159:0:17977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789130609.625519:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130609.897407:0:17922:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:0.0:1789130609.897442:0:17922:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e9c876a1300 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1789130609.897448:0:17922:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9cb4e48a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e9c876a1180 00000020:00080000:0.0:1789130609.897468:0:17922:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e9cb4e48900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e9cb34d0400 00010000:00010000:1.0:1789130609.899225:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509300 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130609.899241:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509300 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130609.899250:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509300 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130609.899257:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982800 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130609.899262:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509300 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130609.899270:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509300 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130609.899312:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9cad811000) 00010000:00010000:1.0:1789130609.899315:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130609.899321:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509300 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130609.899327:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509300 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17943 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0F:1789130609.899875:0:17984:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1789130609.899978:0:17984:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1789130610.413825:0:19450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1789130610.413849:0:19450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:1.0:1789130610.651951:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130610.687694:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130610.687733:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130610.687762:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130610.687785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130610.693556:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834606720 00000100:00100000:1.0:1789130610.693660:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834606976 00000100:00100000:1.0:1789130610.693674:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834606976 00000100:00100000:1.0:1789130610.693740:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834606848 00000100:00100000:1.0:1789130610.693744:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834606848 00000100:00100000:1.0:1789130610.693776:0:20743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 80 00000100:00100000:1.0:1789130610.693785:0:20743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+5:2401:x1876038834606976:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130610.693872:0:20743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+5:2401:x1876038834606976:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 88us (6138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130610.693880:0:20743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 80 00000100:00100000:1.0:1789130610.693896:0:20743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00100000:1.0:1789130610.693902:0:20743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+12:2401:x1876038834606848:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130610.693924:0:20743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+12:2401:x1876038834606848:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 22us (6161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130610.693930:0:20743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00080000:1.0:1789130610.693947:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130610.693951:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130610.694646:0:17936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834606720 00000100:00100000:3.0:1789130610.694686:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 168 00000100:00100000:3.0:1789130610.694693:0:17936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb6070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+13:2401:x1876038834606720:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1789130610.694735:0:17936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb6070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+13:2401:x1876038834606720:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 42us (7050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130610.694741:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 168 00000100:00100000:3.0:1789130610.694777:0:19783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834607104 00000100:00100000:3.0:1789130610.694781:0:19783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834607104 00000100:00100000:3.0:1789130610.694811:0:19783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:3.0:1789130610.694975:0:19783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+6:2401:x1876038834607104:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1789130610.695005:0:19783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+6:2401:x1876038834607104:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 188us (7218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130610.695012:0:19783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:3.0:1789130610.695069:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130610.695116:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130610.695174:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130610.695195:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130610.695216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130610.695410:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834607360 00000100:00100000:1.0:1789130610.695414:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834607360 00000100:00100000:1.0:1789130610.695444:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834607488 00000100:00100000:1.0:1789130610.695447:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834607488 00000100:00100000:1.0:1789130610.695463:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:1.0:1789130610.695470:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5393355-bc11-4930-b9e7-3ea02387995d+6:2400:x1876038834607360:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130610.695504:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5393355-bc11-4930-b9e7-3ea02387995d+6:2400:x1876038834607360:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 35us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130610.695510:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:1.0:1789130610.695521:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 83 00000100:00100000:1.0:1789130610.695527:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5393355-bc11-4930-b9e7-3ea02387995d+5:2400:x1876038834607488:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130610.695548:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5393355-bc11-4930-b9e7-3ea02387995d+5:2400:x1876038834607488:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130610.695555:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 83 00000100:00080000:1.0:1789130610.695583:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130610.695587:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130610.695589:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130610.696521:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834607232 00000100:00100000:3.0:1789130610.696527:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834607232 00000100:00100000:3.0:1789130610.696555:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834607616 00000100:00100000:3.0:1789130610.696569:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834607616 00000100:00100000:3.0:1789130610.696586:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834607744 00000100:00100000:3.0:1789130610.696588:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834607744 00000100:00080000:1.0:1789130610.696656:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130610.696659:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130610.696675:0:19783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:1.0:1789130610.696684:0:19783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+5:2398:x1876038834607232:12345-192.168.202.10@tcp:9:kworker.0 00000020:00000080:1.0:1789130610.696706:0:19783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508fbf 00000100:00080000:1.0:1789130610.696719:0:19783:0:(import.c:65:import_set_state_nolock()) ffff9e9b83311000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789130610.696762:0:19783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789130610.697370:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:3.0:1789130610.697379:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5393355-bc11-4930-b9e7-3ea02387995d+5:2398:x1876038834607616:12345-192.168.202.10@tcp:9:kworker.0 00000020:00000080:3.0:1789130610.697400:0:19456:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ff7 00000100:00080000:3.0:1789130610.697411:0:19456:0:(import.c:65:import_set_state_nolock()) ffff9e9cb3528800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130610.697442:0:19456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789130610.697600:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5393355-bc11-4930-b9e7-3ea02387995d+2:2398:x1876038834607616:12345-192.168.202.10@tcp:9:kworker.0 Request processed in 222us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130610.697608:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:3.0:1789130610.697643:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:3.0:1789130610.697649:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5393355-bc11-4930-b9e7-3ea02387995d+5:2398:x1876038834607744:12345-192.168.202.10@tcp:9:kworker.0 00000020:00000080:3.0:1789130610.697662:0:19456:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ffe 00000100:00080000:3.0:1789130610.697667:0:19456:0:(import.c:65:import_set_state_nolock()) ffff9e9cb352c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130610.697687:0:19456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789130610.697745:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5393355-bc11-4930-b9e7-3ea02387995d+2:2398:x1876038834607744:12345-192.168.202.10@tcp:9:kworker.0 Request processed in 95us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130610.697751:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 35 00010000:00010000:3.0:1789130610.697810:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130610.697958:0:19783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+2:2398:x1876038834607232:12345-192.168.202.10@tcp:9:kworker.0 Request processed in 1275us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130610.697966:0:19783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 33 00010000:00010000:1.0:1789130610.698005:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130610.698101:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130611.585976:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0F:1789130611.586244:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834607872 00000100:00100000:2.0:1789130611.586269:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834607872 00000100:00100000:2.0:1789130611.586356:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:2.0:1789130611.586366:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+12:15874:x1876038834607872:12345-192.168.202.10@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789130611.586472:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+12:15874:x1876038834607872:12345-192.168.202.10@tcp:60:lhsmtool_posix.0 Request processed in 107us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130611.586480:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:1.0:1789130611.589016:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130611.589641:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834608000 00000100:00100000:2.0:1789130611.589651:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834608000 00000100:00100000:2.0:1789130611.589762:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 75 00000100:00100000:2.0:1789130611.589773:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+5:15874:x1876038834608000:12345-192.168.202.10@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789130611.589884:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+5:15874:x1876038834608000:12345-192.168.202.10@tcp:60:lhsmtool_posix.0 Request processed in 113us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130611.589892:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 75 00000100:00100000:0.0:1789130611.594108:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130611.594277:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834608256 00000100:00100000:3.0:1789130611.594289:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834608256 00000100:00100000:3.0:1789130611.594352:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:3.0:1789130611.594362:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b833de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+12:15874:x1876038834608256:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130611.594591:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b833de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+13:15874:x1876038834608256:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 230us (492us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1789130611.594600:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00010000:00010000:2.0:1789130611.675713:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130612.441027:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857764096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130612.441111:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130612.441368:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857764096 00000100:00100000:2.0:1789130612.441376:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857764096 00000100:00100000:2.0:1789130612.441444:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130612.441455:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857764096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130612.441489:0:19458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789130612.441577:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857764096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130612.441585:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130612.441767:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857764096:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789130612.441899:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789130612.696931:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130612.953159:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857764224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130612.953176:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857764352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130612.953475:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3645:1876038857764480:0@lo:400:kworker.0 00000100:00100000:2.0:1789130612.953551:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857764608:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.958858:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130612.958961:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857764736:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.959005:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130612.960321:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857765248:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.960370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130612.960722:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876038857765760:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.960754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130612.960804:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857764736 00000100:00100000:1.0:1789130612.960812:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857764736 00000100:00100000:1.0:1789130612.960863:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857765248 00000100:00100000:1.0:1789130612.960866:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857765248 00000100:00100000:1.0:1789130612.960889:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789130612.960898:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857764736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.960952:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857764736:12345-0@lo:400:kworker.0 Request processed in 56us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130612.960960:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789130612.960977:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130612.960984:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857765248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.961029:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857765248:12345-0@lo:400:kworker.0 Request processed in 46us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130612.961036:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130612.961186:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857765760 00000100:00100000:1.0:1789130612.961191:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857765760 00000100:00100000:1.0:1789130612.961221:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789130612.961229:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876038857765760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.961261:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876038857765760:12345-0@lo:400:kworker.0 Request processed in 34us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130612.961267:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789130612.961292:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130612.961308:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130612.961310:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130612.961337:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1789130612.961342:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b8415b840, transno 8589934596 00000004:00080000:1.0:1789130612.961353:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789130612.961374:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857764736:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.961974:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857765248:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.961984:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876038857765760:0@lo:400:kworker.0 00000100:00100000:3.0:1789130612.963656:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130612.963723:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857764864:0@lo:400:kworker.0 00000100:00100000:3.0:1789130612.963774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130612.963810:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857765376:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.963816:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857764864 00000100:00100000:1.0:1789130612.963822:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857764864 00000100:00100000:3.0:1789130612.963852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130612.963866:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789130612.963869:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b849230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876038857765888:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.963873:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857764864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130612.963888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130612.963916:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857764864:12345-0@lo:400:kworker.0 Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130612.963921:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857764864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.963923:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130612.963948:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857765376 00000100:00100000:3.0:1789130612.963952:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857765888 00000100:00100000:1.0:1789130612.963952:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857765376 00000100:00100000:3.0:1789130612.963955:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857765888 00000100:00100000:1.0:1789130612.963975:0:20743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789130612.963979:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789130612.963981:0:20743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857765376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130612.963984:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876038857765888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.964014:0:20743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857765376:12345-0@lo:400:kworker.0 Request processed in 33us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130612.964018:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876038857765888:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130612.964020:0:20743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789130612.964025:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789130612.964039:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130612.964041:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857764224 00000100:00100000:3.0:1789130612.964043:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857764224 00000100:00080000:1.0:1789130612.964043:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130612.964058:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857764352 00000100:00100000:3.0:1789130612.964061:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857764352 00000100:00100000:3.0:1789130612.964072:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130612.964088:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857764224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130612.964110:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130612.964149:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857764224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (5300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130612.964156:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130612.964167:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130612.964173:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857764352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130612.964181:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130612.964212:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857764352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130612.964218:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130612.964272:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857764224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130612.964296:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857765376:0@lo:400:kworker.0 00010000:00080000:3.0:1789130612.964307:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b849230c0 x1876038857765888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130612.964316:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b849230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876038857765888:0@lo:400:kworker.0 00000100:00100000:3.0:1789130612.964329:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857764352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130612.965199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130612.965245:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876038857764992:0@lo:400:kworker.0 00000100:00100000:0.0:1789130612.965274:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130612.965302:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876038857765504:0@lo:400:kworker.0 00000100:00100000:0.0:1789130612.965326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130612.965351:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857764992 00000100:00100000:0.0:1789130612.965356:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857764992 00000100:00100000:0.0:1789130612.965383:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857765504 00000100:00100000:0.0:1789130612.965386:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857765504 00000100:00100000:0.0:1789130612.965409:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789130612.965414:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876038857764992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130612.965453:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876038857764992:12345-0@lo:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130612.965459:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789130612.965473:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789130612.965479:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84920780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876038857765504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130612.965505:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84920780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876038857765504:12345-0@lo:400:kworker.0 Request processed in 27us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130612.965521:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789130612.965568:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130612.965592:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876038857765504:0@lo:400:kworker.0 00000100:00100000:0.0:1789130612.965629:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876038857764992:0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.969360:0:17937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857764480 00000100:00100000:1.0:1789130612.969374:0:17937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857764480 00000100:00100000:1.0:1789130612.969438:0:17937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789130612.969449:0:17937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+24:3645:x1876038857764480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130612.969556:0:17937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+24:3645:x1876038857764480:12345-0@lo:400:kworker.0 Request processed in 109us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130612.969564:0:17937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789130612.969957:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3645:1876038857764480:0@lo:400:kworker.0 00000100:00100000:2.0:1789130612.970084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130612.970124:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857765120:0@lo:400:kworker.0 00000100:00100000:2.0:1789130612.970152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130612.970195:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857765632:0@lo:400:kworker.0 00000100:00100000:2.0:1789130612.970222:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130612.970313:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857765632 00000100:00100000:3.0:1789130612.970318:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857765632 00000100:00100000:3.0:1789130612.970369:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130612.970376:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857765632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130612.970419:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857765632:12345-0@lo:400:kworker.0 Request processed in 44us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130612.970426:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1789130612.970547:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789130612.970570:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b84921e00 x1876038857765632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130612.970583:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857765632:0@lo:400:kworker.0 00000100:00100000:0.0:1789130612.970647:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857764608 00000100:00100000:0.0:1789130612.970652:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857764608 00000100:00100000:0.0:1789130612.970681:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857765120 00000100:00100000:0.0:1789130612.970684:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857765120 00000100:00100000:0.0:1789130612.970696:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789130612.970702:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857764608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130612.970746:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857764608:12345-0@lo:400:kworker.0 Request processed in 43us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130612.970752:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789130612.970763:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789130612.970769:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857765120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130612.971152:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857765120:12345-0@lo:400:kworker.0 Request processed in 381us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130612.971159:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789130612.971233:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857764608:0@lo:400:kworker.0 00000100:00100000:2.0:1789130612.971245:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857765120:0@lo:400:kworker.0 00000100:00100000:0.0:1789130613.465250:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857766016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130613.465328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130613.465596:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857766016 00000100:00100000:3.0:1789130613.465603:0:18931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857766016 00000100:00100000:3.0:1789130613.465684:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789130613.465693:0:18931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857766016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130613.465729:0:18931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789130613.465784:0:18931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857766016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130613.465791:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789130613.465815:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130613.465837:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857766144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130613.465865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130613.465892:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857766144 00000100:00100000:3.0:1789130613.465896:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857766144 00000100:00100000:3.0:1789130613.465921:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130613.465927:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857766144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130613.465941:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789130613.465974:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857766144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130613.465980:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130613.466026:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857766144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130613.466073:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857766016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130613.466601:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130613.466632:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cbff46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857766272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130613.466667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130613.466791:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857766272 00000100:00100000:1.0:1789130613.466796:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857766272 00000100:00100000:1.0:1789130613.466839:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789130613.466846:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84922940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857766272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130613.466867:0:17947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789130613.466914:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84922940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857766272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130613.466921:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789130613.467067:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cbff46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857766272:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789130613.593876:0:18698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789130613.721527:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130614.751933:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789130615.490848:0:21329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 08:43:34 (1789130614) 00010000:00010000:1.0:1789130615.783340:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130615.804754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130615.804791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130615.804809:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130615.804832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130615.804849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130615.804867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130615.804900:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834608512 00000100:00100000:1.0:1789130615.804911:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834608512 00000100:00100000:1.0:1789130615.804971:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834609024 00000100:00100000:1.0:1789130615.804974:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834609024 00000100:00100000:1.0:1789130615.804986:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834608640 00000100:00100000:1.0:1789130615.804988:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834608640 00000100:00100000:1.0:1789130615.804999:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834608896 00000100:00100000:1.0:1789130615.805002:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834608896 00000100:00100000:1.0:1789130615.805017:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 90 00000100:00100000:1.0:1789130615.805027:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+13:2399:x1876038834608512:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130615.805109:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+13:2399:x1876038834608512:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 83us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130615.805117:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 90 00000100:00100000:1.0:1789130615.805134:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 91 00000100:00100000:1.0:1789130615.805141:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5393355-bc11-4930-b9e7-3ea02387995d+5:2399:x1876038834609024:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130615.805165:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5393355-bc11-4930-b9e7-3ea02387995d+5:2399:x1876038834609024:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 24us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130615.805171:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 91 00000100:00100000:1.0:1789130615.805181:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 92 00000100:00100000:1.0:1789130615.805187:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+5:2399:x1876038834608640:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130615.805205:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+5:2399:x1876038834608640:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 19us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130615.805220:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 92 00000100:00100000:1.0:1789130615.805232:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 93 00000100:00100000:1.0:1789130615.805239:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5393355-bc11-4930-b9e7-3ea02387995d+6:2399:x1876038834608896:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130615.805263:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5393355-bc11-4930-b9e7-3ea02387995d+6:2399:x1876038834608896:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130615.805269:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 93 00000100:00100000:1.0:1789130615.805287:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834608768 00000100:00100000:1.0:1789130615.805290:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834608768 00000100:00100000:1.0:1789130615.805316:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:1.0:1789130615.805322:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+6:2399:x1876038834608768:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130615.805344:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+6:2399:x1876038834608768:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130615.805350:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:1.0:1789130615.805369:0:17935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834608384 00000100:00100000:1.0:1789130615.805372:0:17935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834608384 00000100:00100000:1.0:1789130615.805393:0:17935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 170 00000100:00100000:1.0:1789130615.805399:0:17935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+13:2399:x1876038834608384:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130615.805420:0:17935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+13:2399:x1876038834608384:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 22us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130615.805427:0:17935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 170 00000100:00080000:1.0:1789130615.805455:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130615.805460:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130615.805462:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789130616.036257:0:20270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e8d6f9f-9e1e-455d-b489-a11c95fc382b 00000020:00000080:2.0:1789130616.036267:0:20270:0:(genops.c:885:class_export_put()) final put ffff9e9b83310000/3e8d6f9f-9e1e-455d-b489-a11c95fc382b 00000001:00100000:2.0:1789130616.036281:0:20270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5393355-bc11-4930-b9e7-3ea02387995d 00000020:00000080:2.0:1789130616.036283:0:20270:0:(genops.c:885:class_export_put()) final put ffff9e9cb352d000/d5393355-bc11-4930-b9e7-3ea02387995d 00000020:00000080:3.0:1789130616.036400:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b83310000/3e8d6f9f-9e1e-455d-b489-a11c95fc382b for lustre-OST0001 00000020:00000080:3.0:1789130616.036455:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb352d000/d5393355-bc11-4930-b9e7-3ea02387995d for lustre-OST0001 00000020:00000080:3.0:1789130616.036477:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b83311000 for lustre-OST0001 00000020:00000080:3.0:1789130616.036481:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cb352c000 for lustre-OST0001 00000001:00080000:3.0:1789130616.039129:0:17922:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1789130616.039148:0:17922:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1789130616.041359:0:17984:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1789130616.041375:0:17984:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:2.0:1789130616.042425:0:19450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5393355-bc11-4930-b9e7-3ea02387995d 00000020:00000080:2.0:1789130616.042433:0:19450:0:(genops.c:885:class_export_put()) final put ffff9e9cb352a000/d5393355-bc11-4930-b9e7-3ea02387995d 00000020:00000080:3.0:1789130616.042502:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb352a000/d5393355-bc11-4930-b9e7-3ea02387995d for lustre-OST0000 00000020:00000080:3.0:1789130616.042562:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cb3528800 for lustre-OST0000 00010000:00010000:3.0:1789130616.793496:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130617.570046:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130617.570077:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857766400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130617.570156:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130617.570241:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857766400 00000100:00100000:1.0:1789130617.570249:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857766400 00000100:00100000:1.0:1789130617.570301:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789130617.570310:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857766400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130617.570341:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789130617.570382:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857766400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130617.570389:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789130617.570408:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130617.570442:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857766400:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789130617.816772:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130618.072947:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857766528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130618.073053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130618.073106:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857766656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130618.073131:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130618.073165:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857766528 00000100:00100000:1.0:1789130618.073172:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857766528 00000100:00100000:1.0:1789130618.073214:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857766656 00000100:00100000:1.0:1789130618.073217:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857766656 00000100:00100000:1.0:1789130618.073233:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789130618.073241:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbff44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857766528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130618.073268:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789130618.073311:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbff44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857766528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130618.073318:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789130618.073346:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789130618.073352:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8415b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857766656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789130618.073361:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789130618.073384:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8415b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857766656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130618.073391:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789130618.073409:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130618.073443:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857766528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130618.073457:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857766656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130618.074325:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3642:1876038857766784:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.074375:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130618.074412:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857767296:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.074437:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130618.074453:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876038857767808:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.074477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130618.074510:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789130618.074516:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857766912:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.074539:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130618.074773:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857767424:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.074795:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130618.074810:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876038857767936:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.074832:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130618.074909:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857766784 00000100:00100000:2.0:1789130618.074928:0:17936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857766784 00000100:00100000:2.0:1789130618.074975:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789130618.074983:0:17936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+24:3642:x1876038857766784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130618.075028:0:17936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+24:3642:x1876038857766784:12345-0@lo:400:kworker.0 Request processed in 46us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130618.075035:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789130618.075124:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3642:1876038857766784:0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.078901:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857767296 00000100:00100000:3.0:1789130618.078919:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857767296 00000100:00100000:3.0:1789130618.079000:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857766912 00000100:00100000:3.0:1789130618.079004:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857766912 00000100:00100000:3.0:1789130618.079032:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789130618.079043:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857767296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.079163:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857767296:12345-0@lo:400:kworker.0 Request processed in 122us (4723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130618.079171:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789130618.079189:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130618.079196:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84923840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857766912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.079226:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84923840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857766912:12345-0@lo:400:kworker.0 Request processed in 31us (4686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130618.079232:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130618.079286:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857767040:0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.079324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130618.079350:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876038857767552:0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.079372:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130618.079391:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789130618.079397:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857767168:0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.079416:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130618.079426:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857767680:0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.079444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130618.080547:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857766912:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.080564:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857767296:0@lo:400:kworker.0 00000100:00100000:1.0:1789130618.090117:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857767808 00000100:00100000:1.0:1789130618.090137:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857767808 00000100:00100000:0.0:1789130618.090155:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857767424 00000100:00100000:0.0:1789130618.090160:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857767424 00000100:00100000:2.0:1789130618.090355:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857767936 00000100:00100000:2.0:1789130618.090360:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857767936 00000100:00100000:3.0:1789130618.090412:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857767552 00000100:00100000:3.0:1789130618.090416:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857767552 00000100:00100000:1.0:1789130618.090464:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857767168 00000100:00100000:1.0:1789130618.090468:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857767168 00000100:00100000:0.0:1789130618.100570:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857767680 00000100:00100000:0.0:1789130618.100587:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857767680 00000100:00100000:0.0:1789130618.101014:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789130618.101026:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84921a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876038857767808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.101162:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84921a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876038857767808:12345-0@lo:400:kworker.0 Request processed in 138us (26683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130618.101171:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789130618.101189:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789130618.101211:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857767424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.101245:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857767424:12345-0@lo:400:kworker.0 Request processed in 50us (26449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130618.101252:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789130618.101266:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789130618.101273:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857767680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.101314:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857767680:12345-0@lo:400:kworker.0 Request processed in 41us (21868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130618.101320:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789130618.101382:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857767424:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.101396:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876038857767808:0@lo:400:kworker.0 00000100:00080000:0.0:1789130618.101444:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130618.101449:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130618.101485:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857767040 00000100:00100000:0.0:1789130618.101499:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857767040 00000100:00100000:0.0:1789130618.101779:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130618.101791:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857767040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.101831:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857767040:12345-0@lo:400:kworker.0 Request processed in 43us (22506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130618.101838:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789130618.101854:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789130618.101905:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb4e2de00 x1876038857767680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130618.101918:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857767680:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.101932:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857767040:0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.106526:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789130618.106558:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b849212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876038857767936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130618.106710:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b849212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876038857767936:12345-0@lo:400:kworker.0 Request processed in 172us (31875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130618.106717:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1789130618.106781:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb4e2c780 x1876038857767936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130618.106796:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876038857767936:0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.108422:0:20743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789130618.108442:0:20743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876038857767552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130618.108779:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876038857767552:0@lo:400:kworker.0 00000100:00100000:3.0:1789130618.108869:0:20743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876038857767552:12345-0@lo:400:kworker.0 Request processed in 438us (29495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130618.108876:0:20743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789130618.113406:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789130618.113428:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857767168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130618.113546:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857767168:12345-0@lo:400:kworker.0 Request processed in 130us (34128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130618.113554:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789130618.113859:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857767168:0@lo:400:kworker.0 00000100:00100000:2.0:1789130618.585127:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130618.585153:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857768064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130618.585224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130618.585530:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857768064 00000100:00100000:0.0:1789130618.585663:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130618.585674:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857768192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130618.585715:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130618.585909:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857768192 00000100:00100000:2.0:1789130618.585927:0:18931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857768192 00000100:00100000:2.0:1789130618.585974:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789130618.585984:0:18931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b849221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857768192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130618.586021:0:18931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789130618.586071:0:18931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b849221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857768192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130618.586079:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789130618.586130:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857768192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130618.586248:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130618.586258:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857768320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130618.586291:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130618.586396:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857768320 00000100:00100000:2.0:1789130618.586400:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857768320 00000100:00100000:2.0:1789130618.586470:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130618.586478:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857768320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130618.586502:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789130618.586538:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857768320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130618.586556:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130618.586606:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857768064 00000100:00100000:3.0:1789130618.586649:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789130618.586656:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857768064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789130618.586674:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789130618.586725:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857768064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130618.586732:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789130618.586779:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857768064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130618.588370:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857768320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130618.845094:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130619.433134:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130619.433217:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130619.433328:0:19102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834609152 00000100:00100000:1.0:1789130619.433338:0:19102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834609152 00000100:00100000:1.0:1789130619.433399:0:19102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834609280 00000100:00100000:1.0:1789130619.433413:0:19102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834609280 00000100:00100000:1.0:1789130619.433442:0:19102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:1.0:1789130619.433452:0:19102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84920b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+14:2400:x1876038834609152:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130619.433468:0:19102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130619.433518:0:19102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83a92c00/0x76b2fec9b0508f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14acd expref: 14 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130619.433537:0:19102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130619.433601:0:19102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84920b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+13:2400:x1876038834609152:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 150us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130619.433609:0:19102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:1.0:1789130619.433679:0:19102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:1.0:1789130619.433686:0:19102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b849203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+12:2400:x1876038834609280:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130619.433694:0:19102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130619.433703:0:19102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83a93a00/0x76b2fec9b0508f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14afe expref: 12 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130619.433712:0:19102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130619.433731:0:19102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b849203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+11:2400:x1876038834609280:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 46us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130619.433738:0:19102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:1.0:1789130619.445129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130619.445752:0:19102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834609408 00000100:00100000:3.0:1789130619.445775:0:19102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834609408 00000100:00100000:3.0:1789130619.445845:0:19102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:3.0:1789130619.445854:0:19102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+11:2399:x1876038834609408:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130619.445869:0:19102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130619.445889:0:19102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b0509059 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14bb4 expref: 11 pid: 17937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130619.445906:0:19102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130619.445955:0:19102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+10:2399:x1876038834609408:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 103us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130619.445962:0:19102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1789130619.446562:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130619.446596:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834609664 00000100:00100000:3.0:1789130619.446601:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834609664 00000100:00100000:3.0:1789130619.446669:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:3.0:1789130619.446678:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+6:2398:x1876038834609664:12345-192.168.202.10@tcp:9:umount.0 00000020:00000080:3.0:1789130619.446710:0:19454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508fb8 00000020:00010000:3.0:1789130619.446719:0:19454:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9c846e2800: total 0 00000100:00080000:3.0:1789130619.446723:0:19454:0:(import.c:65:import_set_state_nolock()) ffff9e9c846e6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130619.447229:0:19454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789130619.447384:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+4:2398:x1876038834609664:12345-192.168.202.10@tcp:9:umount.0 Request processed in 705us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130619.447392:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00080000:0.0:1789130619.447961:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1789130619.453686:0:17930:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9c846e2800: total 0 00010000:00010000:1.0:1789130619.453786:0:17930:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9c846e2800, canceled 0 locks, left on hash table 1. 00000100:00100000:3.0:1789130619.454147:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1789130619.454367:0:17930:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789130619.454372:0:17930:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789130619.454419:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b050932a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14c94 expref: 3 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130619.454447:0:17930:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9c846e2800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789130619.454465:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130619.454467:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130619.454469:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130619.455520:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834610560 00000100:00100000:0.0:1789130619.455535:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834610560 00000100:00100000:0.0:1789130619.455715:0:20743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 76 00000100:00100000:0.0:1789130619.455726:0:20743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+12:2398:x1876038834610560:12345-192.168.202.10@tcp:39:umount.0 00000020:00000080:0.0:1789130619.455775:0:20743:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508faa 00000020:00010000:0.0:1789130619.455803:0:20743:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9b84a09000: total 0 00000100:00080000:0.0:1789130619.455808:0:20743:0:(import.c:65:import_set_state_nolock()) ffff9e9b84a0f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789130619.456380:0:20743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000020:00010000:3.0:1789130619.456680:0:17931:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9b84a09000: total 0 00010000:00010000:3.0:1789130619.456686:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130619.456740:0:17931:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9b84a09000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1789130619.456789:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cad811d00) 00010000:00010000:3.0:1789130619.456793:0:17931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130619.456803:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83a92000/0x76b2fec9b05090d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14bd0 expref: 11 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130619.456834:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e9cad811000) 00010000:00010000:3.0:1789130619.456837:0:17931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130619.456842:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83a93200/0x76b2fec9b05092d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14c71 expref: 10 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130619.456861:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9cad811400) 00010000:00010000:3.0:1789130619.456864:0:17931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130619.456868:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83a92800/0x76b2fec9b0509091 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14bc2 expref: 9 pid: 20743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130619.456896:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9cbc5f1c00) 00010000:00010000:3.0:1789130619.456899:0:17931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789130619.456903:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c9fb95400/0x76b2fec9b050927b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14c5c expref: 8 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130619.456916:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e9cbc5f1c00) 00010000:00010000:3.0:1789130619.456928:0:17931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789130619.456934:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c9fb94e00/0x76b2fec9b0509338 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14c9b expref: 7 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130619.456952:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9cad811f00) 00010000:00010000:3.0:1789130619.456955:0:17931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130619.456959:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83a93e00/0x76b2fec9b0509075 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14bbb expref: 6 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130619.456973:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e9cad811200) 00010000:00010000:3.0:1789130619.456976:0:17931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789130619.456981:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402f200/0x76b2fec9b0509155 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14bfa expref: 5 pid: 20743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130619.457006:0:17931:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9b84a09000, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1789130619.457021:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130619.457023:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130619.457025:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130619.457297:0:20743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+3:2398:x1876038834610560:12345-192.168.202.10@tcp:39:umount.0 Request processed in 1571us (3152us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1789130619.457308:0:20743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 76 00000100:00080000:2.0:1789130619.460115:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130619.482431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130619.482558:0:17943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834610688 00000100:00100000:1.0:1789130619.482569:0:17943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834610688 00000100:00100000:1.0:1789130619.482690:0:17943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:1.0:1789130619.482701:0:17943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+5:2398:x1876038834610688:12345-192.168.202.10@tcp:39:umount.0 00000020:00000080:1.0:1789130619.482735:0:17943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508fb1 00000100:00080000:1.0:1789130619.482765:0:17943:0:(import.c:65:import_set_state_nolock()) ffff9e9b84a08800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789130619.482931:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789130619.482985:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:1.0:1789130619.483319:0:17943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789130619.483570:0:17943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e8d6f9f-9e1e-455d-b489-a11c95fc382b+3:2398:x1876038834610688:12345-192.168.202.10@tcp:39:umount.0 Request processed in 868us (1146us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789130619.483579:0:17943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 77 00000040:00080000:0.0:1789130619.609687:0:17977:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789130619.609697:0:17977:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130619.609718:0:17977:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789130619.609728:0:17977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789130619.865375:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130620.888841:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130620.920953:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130620.921005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130620.921045:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130620.921194:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834611072 00000100:00100000:2.0:1789130620.921207:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834611072 00000100:00100000:2.0:1789130620.921301:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834610944 00000100:00100000:2.0:1789130620.921305:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834610944 00000100:00100000:2.0:1789130620.921358:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 100 00000100:00100000:2.0:1789130620.921371:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5393355-bc11-4930-b9e7-3ea02387995d+5:2401:x1876038834611072:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130620.921481:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5393355-bc11-4930-b9e7-3ea02387995d+5:2401:x1876038834611072:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 113us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130620.921489:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 100 00000100:00100000:2.0:1789130620.921510:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 101 00000100:00100000:2.0:1789130620.921517:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84921e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5393355-bc11-4930-b9e7-3ea02387995d+6:2401:x1876038834610944:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130620.921542:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84921e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5393355-bc11-4930-b9e7-3ea02387995d+6:2401:x1876038834610944:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130620.921548:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 101 00000100:00100000:1.0:1789130620.921820:0:17937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834610816 00000100:00100000:1.0:1789130620.921825:0:17937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834610816 00000100:00100000:1.0:1789130620.921874:0:17937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 172 00000100:00100000:1.0:1789130620.921883:0:17937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+10:2401:x1876038834610816:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1789130620.921920:0:17937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+10:2401:x1876038834610816:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 39us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130620.921927:0:17937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 172 00000100:00080000:0.0:1789130620.923668:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130620.923678:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789130621.913728:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130622.233206:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130622.233261:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130622.233363:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834611200 00000100:00100000:1.0:1789130622.233374:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834611200 00000100:00100000:1.0:1789130622.233472:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834611328 00000100:00100000:1.0:1789130622.233476:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834611328 00000100:00100000:1.0:1789130622.233512:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:1.0:1789130622.233530:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b849230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+11:2399:x1876038834611200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130622.233607:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130622.233661:0:17927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb740f600/0x76b2fec9b0508fd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14b3d expref: 11 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130622.233680:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130622.233732:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b849230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+10:2399:x1876038834611200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 205us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130622.233740:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:1.0:1789130622.233758:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:1.0:1789130622.233764:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+9:2399:x1876038834611328:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130622.233771:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130622.233779:0:17927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83983400/0x76b2fec9b0508fdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14b6e expref: 9 pid: 17937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130622.233789:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130622.233927:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+8:2399:x1876038834611328:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 162us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130622.233934:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:1.0:1789130622.241332:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130622.241512:0:19102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834611456 00000100:00100000:2.0:1789130622.241523:0:19102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834611456 00000100:00100000:2.0:1789130622.241587:0:19102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:2.0:1789130622.241598:0:19102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+8:2402:x1876038834611456:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130622.241638:0:19102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130622.241660:0:19102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83a92a00/0x76b2fec9b0509052 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14bad expref: 8 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130622.241678:0:19102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130622.241737:0:19102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+7:2402:x1876038834611456:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130622.241745:0:19102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:2.0:1789130622.249637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130622.252338:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834611712 00000100:00100000:1.0:1789130622.252895:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834611712 00000100:00100000:1.0:1789130622.253052:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:1.0:1789130622.253063:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5393355-bc11-4930-b9e7-3ea02387995d+6:2398:x1876038834611712:12345-192.168.202.10@tcp:39:umount.0 00000020:00000080:1.0:1789130622.253121:0:17942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508fe9 00000020:00010000:1.0:1789130622.253130:0:17942:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9cb3529800: total 0 00000100:00080000:1.0:1789130622.253135:0:17942:0:(import.c:65:import_set_state_nolock()) ffff9e9cb352c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789130622.253165:0:17942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:1.0:1789130622.253319:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5393355-bc11-4930-b9e7-3ea02387995d+5:2398:x1876038834611712:12345-192.168.202.10@tcp:39:umount.0 Request processed in 257us (3704us total) trans 8589934637 rc 0/0 00000100:00100000:1.0:1789130622.253327:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 78 00000020:00010000:3.0:1789130622.254894:0:17930:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9cb3529800: total 0 00010000:00010000:3.0:1789130622.254965:0:17930:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9cb3529800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789130622.255008:0:17930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cad811d00) 00010000:00010000:3.0:1789130622.255013:0:17930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130622.255027:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83a92400/0x76b2fec9b05090de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14bd7 expref: 4 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130622.255054:0:17930:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9cb3529800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789130622.255065:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130622.255067:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130622.255083:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789130622.257350:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130622.275922:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130622.276056:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834611840 00000100:00100000:3.0:1789130622.276067:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834611840 00000100:00100000:3.0:1789130622.276140:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 79 00000100:00100000:3.0:1789130622.276151:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84922d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5393355-bc11-4930-b9e7-3ea02387995d+5:2398:x1876038834611840:12345-192.168.202.10@tcp:39:umount.0 00000020:00000080:3.0:1789130622.276193:0:17944:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ff0 00000100:00080000:3.0:1789130622.276203:0:17944:0:(import.c:65:import_set_state_nolock()) ffff9e9cb352d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130622.276234:0:17944:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1789130622.276382:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84922d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5393355-bc11-4930-b9e7-3ea02387995d+3:2398:x1876038834611840:12345-192.168.202.10@tcp:39:umount.0 Request processed in 233us (470us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789130622.276390:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 79 00010000:00010000:2.0:1789130622.276548:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789130622.276968:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130622.326479:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130622.326932:0:17935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834612096 00000100:00100000:0.0:1789130622.326946:0:17935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834612096 00000100:00100000:2.0:1789130622.327144:0:17935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 173 00000100:00100000:2.0:1789130622.327156:0:17935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+7:2398:x1876038834612096:12345-192.168.202.10@tcp:251:umount.0 00000020:00000080:2.0:1789130622.327217:0:17935:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508f87 00000020:00010000:2.0:1789130622.327226:0:17935:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9b84a09800: total 0 00000100:00080000:2.0:1789130622.327230:0:17935:0:(import.c:65:import_set_state_nolock()) ffff9e9b84a0c000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789130622.327310:0:17935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0277b53-86a4-4cc1-bd4f-14e17234c5fa+3:2398:x1876038834612096:12345-192.168.202.10@tcp:251:umount.0 Request processed in 157us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130622.327318:0:17935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 173 00000020:00010000:0.0:1789130622.327574:0:20979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9b84a09800: total 0 00010000:00010000:0.0:1789130622.327645:0:20979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9b84a09800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789130622.327684:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb740ee00/0x76b2fec9b0508f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14ac6 expref: 2 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130622.327704:0:20979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9b84a09800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789130622.327723:0:20979:0:(genops.c:885:class_export_put()) final put ffff9e9b84a09800/d0277b53-86a4-4cc1-bd4f-14e17234c5fa 00010000:00010000:0.0:1789130622.327747:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130622.327750:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130622.327751:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789130622.327846:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b84a09800/d0277b53-86a4-4cc1-bd4f-14e17234c5fa for MGS 00000020:00000080:3.0:1789130622.327892:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b84a0c000 for MGS 00000100:00100000:1.0:1789130622.683403:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857768448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130622.683487:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130622.683819:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857768448 00000100:00100000:2.0:1789130622.683825:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857768448 00000100:00100000:2.0:1789130622.683875:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130622.683882:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857768448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130622.683907:0:19458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789130622.683941:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857768448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130622.683946:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789130622.683992:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130622.684040:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857768448:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130622.936753:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130623.195707:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857768576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130623.195783:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.195864:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857768576 00000100:00100000:3.0:1789130623.195871:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857768576 00000100:00100000:3.0:1789130623.195929:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789130623.195939:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857768576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130623.195965:0:19458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130623.196004:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857768576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.196012:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789130623.196029:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130623.196063:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857768576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130623.196971:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857768832:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197013:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130623.197042:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857769344:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130623.197076:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857769856:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197098:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130623.197119:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789130623.197124:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857768960:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197148:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130623.197170:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857769472:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197189:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130623.197217:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876038857769984:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197256:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130623.197288:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857769856 00000100:00100000:0.0:1789130623.197294:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857769856 00000100:00100000:0.0:1789130623.197330:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857769984 00000100:00100000:0.0:1789130623.197333:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857769984 00000100:00100000:0.0:1789130623.197353:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130623.197360:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857769856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197400:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857769856:12345-0@lo:400:kworker.0 Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130623.197407:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130623.197428:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789130623.197433:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876038857769984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197473:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876038857769984:12345-0@lo:400:kworker.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130623.197479:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789130623.197497:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857768960 00000100:00100000:0.0:1789130623.197500:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857768960 00000100:00100000:0.0:1789130623.197526:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857769472 00000100:00100000:0.0:1789130623.197529:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857769472 00000100:00100000:0.0:1789130623.197689:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130623.197696:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857768960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197728:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857768960:12345-0@lo:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130623.197734:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130623.197745:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789130623.197751:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857769472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197777:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857769472:12345-0@lo:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130623.197783:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789130623.197822:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857768960:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197832:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857769472:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.197840:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876038857769984:0@lo:400:kworker.0 00010000:00080000:0.0:1789130623.197850:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb74fde00 x1876038857769856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130623.197859:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857769856:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.198175:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857768832 00000100:00100000:3.0:1789130623.198184:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857768832 00000100:00100000:3.0:1789130623.198228:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857769344 00000100:00100000:3.0:1789130623.198231:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857769344 00000100:00100000:3.0:1789130623.198244:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789130623.198250:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857768832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.198294:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857768832:12345-0@lo:400:kworker.0 Request processed in 43us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.198301:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789130623.198315:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130623.198320:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857769344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.198346:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857769344:12345-0@lo:400:kworker.0 Request processed in 26us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.198352:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130623.198378:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3645:1876038857768704:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.198409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.198433:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876038857769216:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.198469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.198484:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876038857769728:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.198502:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.198516:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857770240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130623.198541:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.199047:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789130623.199055:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857769088:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.199082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.199098:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876038857769600:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.199132:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.199147:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857770112:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.199165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130623.199291:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857769088 00000100:00100000:0.0:1789130623.199297:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857769088 00000100:00100000:0.0:1789130623.199331:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789130623.199339:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857769088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.199378:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857769088:12345-0@lo:400:kworker.0 Request processed in 40us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130623.199384:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789130623.199401:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857769216 00000100:00100000:0.0:1789130623.199404:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857769216 00000100:00100000:0.0:1789130623.199420:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857769728 00000100:00100000:0.0:1789130623.199423:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857769728 00000100:00100000:0.0:1789130623.199436:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857769600 00000100:00100000:0.0:1789130623.199438:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857769600 00000100:00100000:0.0:1789130623.199462:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857770112 00000100:00100000:0.0:1789130623.199465:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857770112 00000100:00100000:0.0:1789130623.199479:0:20743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789130623.199484:0:20743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876038857769216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.199512:0:20743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876038857769216:12345-0@lo:400:kworker.0 Request processed in 28us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130623.199518:0:20743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789130623.199528:0:20743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789130623.199601:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857768704 00000100:00100000:3.0:1789130623.199605:0:17936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857768704 00000100:00100000:3.0:1789130623.199663:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789130623.199670:0:17936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+24:3645:x1876038857768704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.199703:0:17936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+24:3645:x1876038857768704:12345-0@lo:400:kworker.0 Request processed in 34us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.199709:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789130623.199738:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789130623.199744:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876038857769600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.199769:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876038857769600:12345-0@lo:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.199775:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789130623.199788:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789130623.199792:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876038857770112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.199816:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876038857770112:12345-0@lo:400:kworker.0 Request processed in 24us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.199821:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789130623.199870:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130623.199875:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130623.199877:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130623.199879:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130623.199908:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857768832:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.199920:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857769344:0@lo:400:kworker.0 00000100:00100000:3.0:1789130623.199951:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857770240 00000100:00100000:3.0:1789130623.199954:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857770240 00000100:00100000:3.0:1789130623.199976:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789130623.199982:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857770240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130623.199997:0:19458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130623.200026:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857770240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.200032:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789130623.200296:0:20743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876038857769728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.200439:0:20743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876038857769728:12345-0@lo:400:kworker.0 Request processed in 905us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130623.200456:0:20743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130623.200492:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857769088:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.200504:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876038857769600:0@lo:400:kworker.0 00010000:00080000:0.0:1789130623.200526:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb74fda40 x1876038857770112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130623.200768:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857770112:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.200786:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3645:1876038857768704:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.200798:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876038857769216:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.200808:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876038857769728:0@lo:400:kworker.0 00000100:00100000:0.0:1789130623.200822:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857770240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130623.706090:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130623.706112:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857770368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130623.706181:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.706269:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857770368 00000100:00100000:3.0:1789130623.706276:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857770368 00000100:00100000:3.0:1789130623.706323:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130623.706332:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857770368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130623.706362:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789130623.706407:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857770368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.706414:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130623.706465:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857770368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130623.707784:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857770496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130623.707835:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130623.708318:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857770496 00000100:00100000:2.0:1789130623.708325:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857770496 00000100:00100000:2.0:1789130623.708372:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789130623.708380:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857770496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130623.708409:0:17947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789130623.708464:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857770496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130623.708470:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789130623.708516:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857770496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130623.709208:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130623.709220:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857770624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130623.709275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130623.709368:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857770624 00000100:00100000:3.0:1789130623.709373:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857770624 00000100:00100000:3.0:1789130623.709407:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789130623.709414:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857770624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130623.709429:0:19458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789130623.709476:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857770624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130623.709489:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789130623.709533:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857770624:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789130623.847528:0:18698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789130623.961340:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789130624.189722:0:21525:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789130624.206495:0:21525:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789130624.206558:0:21525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.206584:0:21525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.206593:0:21525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.206600:0:21525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.206646:0:21525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789130624.206653:0:21525:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789130624.206682:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789130624.206687:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789130624.206692:0:21525:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789130624.206716:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9b82104800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789130624.206870:0:20979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130624.206877:0:20979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130624.206885:0:20979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8a00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:0.0:1789130624.206889:0:20979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130624.206898:0:20979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130624.206906:0:20979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130624.206918:0:20979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789130624.206921:0:20979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789130624.206924:0:20979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789130624.206949:0:20979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130624.206956:0:20979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130624.206976:0:20979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130624.206983:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8a00/0x76b2fec9b0508b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508b51 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130624.206995:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130624.206997:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130624.206999:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130624.207862:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130624.207884:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3644:1876038857770880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130624.207951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130624.208888:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876038857770752:0@lo:39:umount.0 00000100:00100000:3.0:1789130624.208929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130624.208987:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857770880 00000100:00100000:3.0:1789130624.208994:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857770880 00000100:00100000:3.0:1789130624.209047:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789130624.209056:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8423d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+24:3644:x1876038857770880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130624.209070:0:17928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130624.209087:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb740fe00/0x76b2fec9b0508b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508b4a expref: 24 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130624.209102:0:17928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130624.209136:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8423d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+23:3644:x1876038857770880:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130624.209219:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857770752 00000100:00100000:2.0:1789130624.209224:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857770752 00000100:00100000:2.0:1789130624.209264:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789130624.209271:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876038857770752:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789130624.209296:0:17942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508b7b 00000100:00080000:2.0:1789130624.209305:0:17942:0:(import.c:65:import_set_state_nolock()) ffff9e9cada63000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789130624.209358:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1876038857770752:12345-0@lo:39:umount.0 Request processed in 88us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130624.209366:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:2.0:1789130624.209379:0:17942:0:(genops.c:885:class_export_put()) final put ffff9e9cada60000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1789130624.212338:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789130624.212449:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3644:1876038857770880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130624.212481:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130624.212503:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b82104800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789130624.212514:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876038857770752:0@lo:39:umount.0 00000020:00000080:1.0:1789130624.212851:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cada60000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789130624.212917:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cada63000 for lustre-MDT0000 00000100:00080000:2.0:1789130624.215133:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789130624.215140:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789130624.215156:0:21525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789130624.216038:0:21525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216054:0:21525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216061:0:21525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216068:0:21525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216092:0:21525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130624.216106:0:17931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130624.216112:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216119:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402fe00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130624.216123:0:17931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216132:0:17931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130624.216140:0:17931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130624.216146:0:17931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789130624.216149:0:17931:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789130624.216178:0:17931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216193:0:17931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130624.216217:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216224:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b8402fe00/0x76b2fec9b0508a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508aa2 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216237:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130624.216239:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130624.216240:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130624.216248:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130624.216264:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3643:1876038857771008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130624.216327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130624.216380:0:19102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857771008 00000100:00100000:2.0:1789130624.216386:0:19102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857771008 00000100:00100000:2.0:1789130624.216430:0:19102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789130624.216451:0:19102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+23:3643:x1876038857771008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130624.216464:0:19102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130624.216478:0:19102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c829d9e00/0x76b2fec9b0508aa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508a9b expref: 23 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216491:0:19102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130624.216526:0:19102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+22:3643:x1876038857771008:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130624.216533:0:19102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789130624.216570:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3643:1876038857771008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130624.216593:0:21525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216607:0:21525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216633:0:21525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216640:0:21525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216660:0:21525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130624.216666:0:21525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216672:0:21525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216678:0:21525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216684:0:21525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216694:0:21525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789130624.216699:0:21525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216705:0:21525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216721:0:21525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216727:0:21525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216738:0:21525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789130624.216742:0:21525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789130624.216750:0:21525:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789130624.216778:0:17931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789130624.216782:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216788:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9a00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130624.216791:0:17931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216799:0:17931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130624.216805:0:17931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130624.216810:0:17931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789130624.216813:0:17931:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789130624.216815:0:17931:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789130624.216829:0:17931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216834:0:17931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130624.216852:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216859:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9a00/0x76b2fec9b0508eae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508eb5 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216867:0:17931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130624.216871:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216876:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e400 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130624.216879:0:17931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216885:0:17931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130624.216891:0:17931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130624.216897:0:17931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789130624.216899:0:17931:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789130624.216900:0:17931:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789130624.216913:0:17931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216918:0:17931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130624.216929:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216936:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e400/0x76b2fec9b0509044 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b050904b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216955:0:17931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130624.216958:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216964:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e600 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130624.216967:0:17931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.216973:0:17931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130624.216979:0:17931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130624.216984:0:17931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789130624.216986:0:17931:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789130624.216987:0:17931:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789130624.217000:0:17931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.217006:0:17931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130624.217012:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.217017:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e600/0x76b2fec9b0508a8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508a94 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130624.217025:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130624.217027:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130624.217035:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130624.217046:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3643:1876038857771136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130624.217073:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1789130624.217103:0:21525:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789130624.217108:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789130624.217112:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130624.217118:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789130624.217123:0:21525:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e9b84a08000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130624.217128:0:21525:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e9b82a79000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130624.217132:0:21525:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e9b83bdc800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130624.217136:0:21525:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e9b82a97800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130624.217143:0:21525:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9e9cb3529800 d5393355-bc11-4930-b9e7-3ea02387995d 192.168.202.10@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1789130624.217147:0:21525:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9e9b84a09000 3e8d6f9f-9e1e-455d-b489-a11c95fc382b 192.168.202.10@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934635 stale:0 00000020:00080000:2.0:1789130624.217152:0:21525:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e9b82bbb490) has exports, disconnecting them 00000020:00080000:2.0:1789130624.217157:0:21525:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e9b84a08000), last request at 1789130623 00000020:00000080:2.0:1789130624.217164:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508e7d 00000100:00080000:2.0:1789130624.217180:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9b84a0e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789130624.217215:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789130624.217226:0:21525:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b84a08000): rc 0 00000020:00000080:2.0:1789130624.217229:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b84a08000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789130624.217237:0:21525:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e9b82a79000), last request at 1789130623 00000020:00000080:2.0:1789130624.217240:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508d18 00000100:00080000:2.0:1789130624.217245:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9b82a7e800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789130624.217255:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789130624.217262:0:21525:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b82a79000): rc 0 00000020:00000080:2.0:1789130624.217265:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b82a79000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789130624.217275:0:21525:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e9b83bdc800), last request at 1789130541 00000020:00000080:2.0:1789130624.217278:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508c69 00000100:00080000:2.0:1789130624.217281:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9b83bdb000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789130624.217292:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789130624.217299:0:21525:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b83bdc800): rc 0 00000020:00000080:2.0:1789130624.217301:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b83bdc800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789130624.217304:0:21525:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e9b82a97800), last request at 1789130541 00000020:00000080:2.0:1789130624.217308:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508c0e 00000100:00080000:2.0:1789130624.217310:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9cb3dc1800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789130624.217319:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789130624.217325:0:21525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:2.0:1789130624.217392:0:21525:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b82a97800): rc 0 00000004:00000080:2.0:1789130624.217398:0:21525:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffade747927ae0 00000100:00080000:2.0:1789130624.217416:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789130624.217419:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1789130624.217640:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130624.217915:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857771136 00000100:00100000:1.0:1789130624.217921:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857771136 00000100:00100000:1.0:1789130624.217971:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130624.217979:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+22:3643:x1876038857771136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130624.217990:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130624.218001:0:17927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b0508eb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508eae expref: 22 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130624.218011:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130624.218054:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+21:3643:x1876038857771136:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130624.218061:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:00000080:1.0:1789130624.218081:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b84a08000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789130624.218127:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82a79000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789130624.218148:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b83bdc800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789130624.218171:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b84a0e000 for lustre-MDT0000 00000020:00000080:1.0:1789130624.218175:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b82a7e800 for lustre-MDT0000 00000020:00000080:1.0:1789130624.218180:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b83bdb000 for lustre-MDT0000 00000100:00100000:1.0:1789130624.218203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3643:1876038857771136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130624.219027:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130624.219045:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3644:1876038857771264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130624.219089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130624.219134:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130624.219162:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3644:1876038857771392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130624.219184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130624.219212:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857771264 00000100:00100000:3.0:1789130624.219216:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857771264 00000100:00100000:3.0:1789130624.219257:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857771392 00000100:00100000:3.0:1789130624.219260:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857771392 00000100:00100000:3.0:1789130624.219277:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130624.219284:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+22:3644:x1876038857771264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130624.219293:0:17928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130624.219308:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83a93000/0x76b2fec9b050904b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0509044 expref: 22 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130624.219319:0:17928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130624.219347:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+21:3644:x1876038857771264:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130624.219355:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130624.219369:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130624.219376:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+20:3644:x1876038857771392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130624.219383:0:17928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130624.219391:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb740f800/0x76b2fec9b0508a94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508a8d expref: 20 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130624.219400:0:17928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130624.219420:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3345e3c-72dd-4a08-a1e2-d786a027f7a0+19:3644:x1876038857771392:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130624.219426:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130624.219464:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3644:1876038857771392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130624.219472:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3644:1876038857771264:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789130624.223962:0:21525:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789130624.224004:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9c82ab8800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789130624.224058:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857771520:0@lo:39:umount.0 00000100:00100000:3.0:1789130624.224129:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789130624.225716:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789130624.225723:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1789130624.225743:0:21525:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789130624.225806:0:21525:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789130624.225826:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9cad710800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789130624.225839:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789130624.225841:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1789130624.225852:0:21525:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789130624.225907:0:21525:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789130624.225916:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9c90995000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789130624.225957:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e9b82bbb490) has no exports 00000100:00100000:3.0:1789130624.226031:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857771648:0@lo:9:umount.0 00000100:00100000:3.0:1789130624.226082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130624.226114:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857771776:0@lo:9:umount.0 00000100:00100000:3.0:1789130624.226133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130624.226179:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857771648 00000100:00100000:3.0:1789130624.226186:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857771648 00000100:00100000:3.0:1789130624.226224:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857771776 00000100:00100000:3.0:1789130624.226236:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857771776 00000100:00100000:3.0:1789130624.226258:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130624.226265:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3491e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876038857771648:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789130624.226289:0:19454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508d5e 00000100:00080000:3.0:1789130624.226299:0:19454:0:(import.c:65:import_set_state_nolock()) ffff9e9cbc271800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130624.226336:0:19454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789130624.226453:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3491e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3641:x1876038857771648:12345-0@lo:9:umount.0 Request processed in 186us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130624.226461:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130624.226476:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130624.226483:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3493840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876038857771776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789130624.226493:0:19454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ebc 00000100:00080000:3.0:1789130624.226499:0:19454:0:(import.c:65:import_set_state_nolock()) ffff9e9b83314800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130624.226518:0:19454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789130624.226596:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3493840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3641:x1876038857771776:12345-0@lo:9:umount.0 Request processed in 114us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130624.226602:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1789130624.226661:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130624.226667:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130624.226690:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cad710800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789130624.226695:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789130624.226697:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789130624.226700:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857771648:0@lo:9:umount.0 00000100:00080000:3.0:1789130624.226710:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90995000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789130624.226712:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789130624.226713:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789130624.226715:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857771776:0@lo:9:umount.0 00000100:00100000:0.0:1789130624.228394:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857771520 00000100:00100000:0.0:1789130624.228406:0:18931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857771520 00000100:00100000:0.0:1789130624.228471:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789130624.228480:0:18931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3492580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876038857771520:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789130624.228509:0:18931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508c93 00000100:00080000:0.0:1789130624.228518:0:18931:0:(import.c:65:import_set_state_nolock()) ffff9e9b83bdf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789130624.228550:0:18931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789130624.228729:0:18931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3492580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3641:x1876038857771520:12345-0@lo:39:umount.0 Request processed in 250us (4599us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789130624.228746:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789130624.228784:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c82ab8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789130624.228792:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857771520:0@lo:39:umount.0 00010000:00010000:3.0:1789130624.228969:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789130624.244270:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e9b82bbb490) has no exports 00000020:00000080:3.0:1789130624.320238:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ae8 00000020:00000080:3.0:1789130624.320255:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cad714000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789130624.320294:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789130624.320640:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cad714000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789130624.320690:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130624.320700:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789130624.320704:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e9cb2ed0000) has no exports 00000020:00000080:2.0:1789130624.321232:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ae1 00000020:00000080:2.0:1789130624.321238:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cadade800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789130624.321293:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789130624.321301:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789130624.321304:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cadad5000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789130624.321306:0:21525:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cadad5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789130624.321310:0:21525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789130624.321542:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cadade800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789130624.984797:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789130625.246050:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789130625.246067:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789130625.246072:0:18677:0:(genops.c:885:class_export_put()) final put ffff9e9b82a95000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789130625.246101:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d5393355-bc11-4930-b9e7-3ea02387995d 00000001:00080000:1.0:1789130625.246106:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789130625.246108:0:18677:0:(genops.c:885:class_export_put()) final put ffff9e9cb352b000/d5393355-bc11-4930-b9e7-3ea02387995d 00000001:00100000:1.0:1789130625.246114:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3e8d6f9f-9e1e-455d-b489-a11c95fc382b 00000001:00080000:1.0:1789130625.246119:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789130625.246120:0:18677:0:(genops.c:885:class_export_put()) final put ffff9e9b84a0f000/3e8d6f9f-9e1e-455d-b489-a11c95fc382b 00000020:00000080:2.0:1789130625.246326:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82a95000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789130625.246387:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb352b000/d5393355-bc11-4930-b9e7-3ea02387995d for lustre-MDT0001 00000020:00000080:2.0:1789130625.246434:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b84a0f000/3e8d6f9f-9e1e-455d-b489-a11c95fc382b for lustre-MDT0001 00000020:00000080:2.0:1789130625.246457:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b83bdf800 for lustre-MDT0001 00000020:00000080:2.0:1789130625.246461:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cb352d800 for lustre-MDT0001 00000020:00000080:2.0:1789130625.246464:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b84a08800 for lustre-MDT0001 00000001:00100000:2.0:1789130625.251664:0:19450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789130625.251674:0:19450:0:(genops.c:885:class_export_put()) final put ffff9e9cbc272800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789130625.251712:0:19450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e8d6f9f-9e1e-455d-b489-a11c95fc382b 00000020:00000080:2.0:1789130625.251715:0:19450:0:(genops.c:885:class_export_put()) final put ffff9e9c846e2800/3e8d6f9f-9e1e-455d-b489-a11c95fc382b 00000020:00000080:1.0:1789130625.251886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cbc272800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789130625.251947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c846e2800/3e8d6f9f-9e1e-455d-b489-a11c95fc382b for lustre-OST0000 00000020:00000080:1.0:1789130625.251966:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cbc271800 for lustre-OST0000 00000020:00000080:1.0:1789130625.251971:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9c846e6800 for lustre-OST0000 00000001:00100000:3.0:1789130625.252592:0:17922:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789130625.252597:0:17922:0:(genops.c:885:class_export_put()) final put ffff9e9b82a97800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789130625.252660:0:17922:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5393355-bc11-4930-b9e7-3ea02387995d 00000001:00080000:3.0:1789130625.252669:0:17922:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1789130625.252672:0:17922:0:(genops.c:885:class_export_put()) final put ffff9e9cb3529800/d5393355-bc11-4930-b9e7-3ea02387995d 00000001:00100000:3.0:1789130625.252678:0:17922:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e8d6f9f-9e1e-455d-b489-a11c95fc382b 00000001:00080000:3.0:1789130625.252838:0:17922:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:3.0:1789130625.252841:0:17922:0:(genops.c:885:class_export_put()) final put ffff9e9b84a09000/3e8d6f9f-9e1e-455d-b489-a11c95fc382b 00000020:00000080:2.0:1789130625.253005:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82a97800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789130625.253053:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb3529800/d5393355-bc11-4930-b9e7-3ea02387995d for lustre-MDT0000 00000020:00000080:2.0:1789130625.253075:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b84a09000/3e8d6f9f-9e1e-455d-b489-a11c95fc382b for lustre-MDT0000 00000020:00000080:2.0:1789130625.253096:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cb3dc1800 for lustre-MDT0000 00000020:00000080:2.0:1789130625.253099:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cb352c800 for lustre-MDT0000 00000020:00000080:2.0:1789130625.253103:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b84a0f800 for lustre-MDT0000 00010000:00010000:3.0:1789130626.008839:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789130626.328998:0:21525:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9cbc11d180 - data ffff9e9c9f14f288/ffff9e9b8333a400 00000020:01000000:2.0:1789130626.329173:0:21525:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9cb4f27e40 - data ffff9e9c9f199000/ffff9e9cbd399c00 00000001:00000004:2.0:1789130626.337010:0:21525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:1.0:1789130626.400980:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789130626.400989:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789130626.401004:0:21525:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e9cb4e2f0c0 x1876038857771520/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789130634 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130626.401029:0:21525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789130626.402101:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789130626.402107:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1789130626.402119:0:21525:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130626.402141:0:21525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789130626.402286:0:17966:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789130626.402292:0:17966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1789130626.402302:0:17966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789130626.402790:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789130626.402794:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1789130626.402805:0:21525:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130626.402807:0:21525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789130626.403088:0:17968:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789130626.403092:0:17968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1789130626.403101:0:17968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789130626.426229:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ab0 00000020:00000080:1.0:1789130626.426243:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9c9a0af000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789130626.427002:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c9a0af000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789130626.433186:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ac5 00000020:00000080:1.0:1789130626.433199:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cad712800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789130626.433223:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789130626.433229:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130626.433238:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789130626.433241:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e9b82bb8000) has no exports 00000004:01000000:1.0:1789130626.433403:0:21525:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789130626.433422:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508b27 00000020:00000080:1.0:1789130626.433427:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cb3dc3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789130626.433430:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789130626.433434:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130626.433438:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789130626.433441:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9e9c90d9b490) has no exports 00000020:00000080:1.0:1789130626.433447:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508b20 00000020:00000080:1.0:1789130626.433450:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9c90990000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789130626.433787:0:21525:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789130626.433792:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789130626.433796:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789130626.433802:0:21525:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130626.433805:0:21525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130626.433835:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130626.433841:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130626.433848:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508b12 00000020:00000080:1.0:1789130626.433862:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9c90997800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789130626.433866:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789130626.433869:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130626.433873:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789130626.433875:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e9c90d99a48) has no exports 00000020:00000080:1.0:1789130626.433879:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508b0b 00000020:00000080:1.0:1789130626.433882:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cad715000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789130626.434189:0:21525:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789130626.434193:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789130626.434195:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1789130626.434199:0:21525:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130626.434200:0:21525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130626.434221:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130626.434226:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789130626.434234:0:21525:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789130626.434238:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508afd 00000020:00000080:1.0:1789130626.434242:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b82a25800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789130626.434245:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789130626.434249:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130626.434251:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789130626.434254:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9e9c90d98000) has no exports 00000020:00000080:1.0:1789130626.434258:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508af6 00000020:00000080:1.0:1789130626.434260:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b8438e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789130626.435063:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cad712800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1789130626.435083:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb3dc3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789130626.435092:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c90990000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789130626.435107:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9c90995000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789130626.435113:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9c90995800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789130626.435115:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c90995800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789130626.435119:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789130626.435197:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c90997800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789130626.435202:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cad715000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789130626.435206:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cad710800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789130626.435209:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9b82a26800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789130626.435211:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82a26800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789130626.435214:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789130626.435246:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82a25800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789130626.435252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b8438e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789130626.454342:0:21525:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789130626.454351:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789130626.454356:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789130626.454365:0:21525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130626.454466:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130626.454479:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130626.454514:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130626.454518:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130626.454523:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b84389000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789130626.454540:0:21525:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b84389000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789130626.454549:0:21525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130626.454888:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508acc 00000020:00000080:1.0:1789130626.454896:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cad716800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789130626.456003:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9c82ab8800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789130626.456015:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9cad715800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789130626.456019:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cad715800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789130626.456025:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789130626.456561:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789130626.456568:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130626.456576:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789130626.456581:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e9b82bbced8) has no exports 00000020:00000080:1.0:1789130626.456603:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130626.456608:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789130626.456634:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ad3 00000020:00000080:1.0:1789130626.456888:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cad710000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789130626.457185:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cad716800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789130626.457190:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9c82abc800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789130626.457192:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c82abc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789130626.457197:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1789130626.457334:0:21525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9cb758f000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789130626.457338:0:21525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9cb758f000 3 00000020:01000004:1.0:1789130626.457341:0:21525:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9cb758f000 from lustre-MDT0000 00000020:00000080:1.0:1789130626.457358:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130626.457362:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789130626.457365:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9c9a0ad000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789130626.457368:0:21525:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c9a0ad000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789130626.457374:0:21525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789130626.457421:0:21525:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789130626.457424:0:21525:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789130626.457428:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789130626.457432:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130626.457435:0:21525:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789130626.457441:0:21525:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e9c83b02000 a3345e3c-72dd-4a08-a1e2-d786a027f7a0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789130626.457446:0:21525:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e9b82bb9a48) has exports, disconnecting them 00000020:00080000:1.0:1789130626.457450:0:21525:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e9c83b02000), last request at 1789130526 00000020:00000080:1.0:1789130626.457468:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508a78 00000020:00010000:1.0:1789130626.457472:0:21525:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e9c83b02000: total 1 00000100:00080000:1.0:1789130626.457476:0:21525:0:(import.c:65:import_set_state_nolock()) ffff9e9c942f5000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789130626.457535:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cad710000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1789130626.457927:0:21525:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9c83b02000): rc 0 00000020:00080000:1.0:1789130626.457942:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e9b82bb9a48) has no exports 00000100:00100000:3.0:1789130626.458089:0:17935:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e9b82a67400:17935] 0 exiting: rc = 1 00000100:00100000:3.0:1789130626.458184:0:17936:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e9c9fa31a00:17936] 1 exiting: rc = 0 00000100:00100000:3.0:1789130626.458238:0:17937:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e9cb3d27400:17937] 2 exiting: rc = 0 00000020:00010000:2.0:1789130626.458329:0:17930:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e9c83b02000: total 0 00010000:00010000:2.0:1789130626.458334:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130626.458425:0:17930:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e9c83b02000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789130626.458456:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b8402fc00/0x76b2fec9b0508cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508cd2 expref: 14 pid: 17937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458485:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b8402e000/0x76b2fec9b0508e68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508e61 expref: 13 pid: 17937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458497:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c829d8000/0x76b2fec9b0508ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508ea0 expref: 12 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458523:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb740f200/0x76b2fec9b0509021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b050901a expref: 11 pid: 17937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458533:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c829d9800/0x76b2fec9b0508b97 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508b90 expref: 10 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458544:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c829d8c00/0x76b2fec9b0508ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508b9e expref: 9 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458555:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050903d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0509036 expref: 8 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458564:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b8402f800/0x76b2fec9b0508bb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508bac expref: 7 pid: 17935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458574:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c829d8800/0x76b2fec9b0508a86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508a7f expref: 6 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458583:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b8402fa00/0x76b2fec9b0508d03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508cfc expref: 5 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.458593:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83983800/0x76b2fec9b050902f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0509028 expref: 4 pid: 17937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.459133:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb740f400/0x76b2fec9b0508c54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508c4d expref: 3 pid: 17937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.459150:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b8402ea00/0x76b2fec9b0508e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76b2fec9b0508e37 expref: 2 pid: 17937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130626.459161:0:17930:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e9c83b02000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789130626.459182:0:17930:0:(genops.c:885:class_export_put()) final put ffff9e9c83b02000/a3345e3c-72dd-4a08-a1e2-d786a027f7a0 00010000:00010000:3.0:1789130626.459196:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130626.459199:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130626.459201:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789130626.459253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c83b02000/a3345e3c-72dd-4a08-a1e2-d786a027f7a0 for MGS 00000020:00000080:2.0:1789130626.459294:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9c942f5000 for MGS 00000100:00100000:1.0:1789130626.484057:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484068:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484074:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484079:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484085:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484091:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484097:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484103:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484108:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484114:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484119:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484125:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484131:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484136:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484142:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484147:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484152:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484157:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484162:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484168:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484172:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484178:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484182:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484187:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484192:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484197:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484202:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484207:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484214:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484219:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484225:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484230:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484235:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484242:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484259:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484264:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484269:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484274:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484278:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484284:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484289:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484294:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484299:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484304:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484309:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484313:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484318:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484324:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484329:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484333:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484338:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484344:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484349:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484354:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484359:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484364:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484370:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484376:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484381:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484386:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484391:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484397:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484402:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130626.484407:0:21525:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789130626.485851:0:21525:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9cbc11db40 - data ffff9e9c9f016288/ffff9e9b8333bc00 00000020:01000000:1.0:1789130626.485948:0:21525:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9c83f09060 - data ffff9e9c98a64af8/ffff9e9cb61d6400 00000020:00000080:1.0:1789130626.486342:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508a5c 00000020:00000080:1.0:1789130626.486352:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b8438c000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789130626.486377:0:21525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9cb758f000 from MGS, refs=2 00000020:01000004:1.0:1789130626.486380:0:21525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9cb758f000 2 00000020:01000004:1.0:1789130626.486383:0:21525:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9cb758f000 from MGS 00000020:00000080:1.0:1789130626.486406:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130626.486426:0:21525:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789130626.486429:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b8438c800/MGS 00000020:00000080:1.0:1789130626.486432:0:21525:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b8438c800/MGS for MGS 00000020:01000000:1.0:1789130626.486439:0:21525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789130626.486569:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789130626.486574:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130626.486580:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789130626.486588:0:21525:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e9b82102800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789130626.486594:0:21525:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9e9cb3beced8) has exports, disconnecting them 00000020:00080000:1.0:1789130626.486598:0:21525:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e9b82102800), last request at 1789130527 00000020:00000080:1.0:1789130626.486603:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508b5f 00000020:00080000:1.0:1789130626.486609:0:21525:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b82102800): rc 0 00000020:00000080:1.0:1789130626.486634:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b82102800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789130626.487287:0:21525:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789130626.487293:0:21525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789130626.487297:0:21525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789130626.487303:0:21525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130626.487904:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130626.487911:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789130626.487917:0:21525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9cb758f000 1 00000020:00000080:1.0:1789130626.487922:0:21525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508a4e 00000020:00000080:1.0:1789130626.487928:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9b8438f000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789130626.487933:0:21525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789130626.487937:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130626.487940:0:21525:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789130626.487943:0:21525:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e9cb3be8000) has no exports 00000020:00000080:2.0:1789130626.488673:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b8438c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789130626.488688:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82102800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789130626.488694:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b82104800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789130626.488701:0:12461:0:(genops.c:885:class_export_put()) final put ffff9e9cadad7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789130626.488703:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cadad7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789130626.488707:0:12461:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789130626.488781:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b8438f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789130626.545328:0:21525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130626.545344:0:21525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789130626.545350:0:21525:0:(genops.c:885:class_export_put()) final put ffff9e9cb758c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789130626.545355:0:21525:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb758c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789130626.545368:0:21525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789130626.545607:0:21525:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e9cb758a800 00000020:02000400:3.0:1789130626.545687:0:21525:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789130627.032832:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130627.801056:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3492940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857771904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130627.801130:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130627.801214:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857771904 00000100:00100000:1.0:1789130627.801235:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857771904 00000100:00100000:1.0:1789130627.801294:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789130627.801304:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857771904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130627.801335:0:19458:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789130627.802076:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130627.802325:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857771904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1020us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130627.802334:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130627.803480:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3492940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857771904:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130628.056792:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130628.312913:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3643:1876038857772032:0@lo:400:kworker.0 00000400:00000100:3.0:1789130628.312998:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876038857772032 offset 0 length 224: 4 00000100:00100000:3.0:1789130628.313062:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876038857772544:0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.313121:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130628.313228:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857772416:0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.313245:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857773056:0@lo:400:kworker.0 00000100:00100000:0.0:1789130628.313866:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857772544 00000100:00100000:0.0:1789130628.313878:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857772544 00000100:00100000:0.0:1789130628.313951:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789130628.313961:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3491a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876038857772544:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789130628.313973:0:17944:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789130628.314150:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130628.314232:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857772160:0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.314507:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130628.314532:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876038857772672:0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.314568:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130628.314593:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789130628.314600:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857772288:0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.314657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130628.314677:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857772800:0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.314700:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130628.314790:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857773056 00000100:00100000:3.0:1789130628.314795:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857773056 00000100:00100000:3.0:1789130628.314839:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857772672 00000100:00100000:3.0:1789130628.314842:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857772672 00000100:00100000:3.0:1789130628.314851:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857772800 00000100:00100000:3.0:1789130628.314853:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857772800 00000100:00100000:3.0:1789130628.314870:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789130628.314876:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3492d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876038857773056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.314936:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3492d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876038857773056:12345-0@lo:400:kworker.0 Request processed in 59us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130628.314944:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789130628.314965:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789130628.314971:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3491680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857772800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.315000:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3491680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857772800:12345-0@lo:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130628.315005:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789130628.315018:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130628.315021:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3490780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876038857772672:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789130628.315037:0:17942:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789130628.315067:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3490780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876038857772672:12345-0@lo:400:kworker.0 Request processed in 43us (498us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789130628.315073:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130628.315113:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857772288 00000100:00100000:3.0:1789130628.315117:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857772288 00000100:00100000:3.0:1789130628.315153:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789130628.315162:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857772288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130628.315195:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857772288:12345-0@lo:400:kworker.0 Request processed in 35us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130628.315211:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1789130628.315228:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130628.315241:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130628.315262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3493c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857773184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130628.315703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130628.315876:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857773184 00000100:00100000:3.0:1789130628.315883:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857773184 00000100:00100000:3.0:1789130628.315930:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789130628.315936:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3492940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857773184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130628.315969:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130628.316012:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3492940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857773184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130628.316019:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789130628.316039:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130628.316082:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3493c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857773184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130628.316419:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857772288:0@lo:400:kworker.0 00010000:00080000:3.0:1789130628.316445:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e9cb359de00 x1876038857772800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130628.316470:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857772800:0@lo:400:kworker.0 00000100:00080000:3.0:1789130628.316505:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789130628.316514:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9e9b8320d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789130628.316519:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:2.0:1789130628.316604:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e9cb359c000 x1876038857773056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130628.316652:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857773056:0@lo:400:kworker.0 00000100:00100000:1.0:1789130628.317404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130628.317447:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876038857772928:0@lo:400:kworker.0 00000100:00100000:1.0:1789130628.317491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130628.317675:0:19455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857772416 00000100:00100000:2.0:1789130628.317684:0:19455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857772416 00000100:00100000:2.0:1789130628.317734:0:19455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130628.317824:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3491a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876038857772544:12345-0@lo:400:kworker.0 Request processed in 3856us (4695us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789130628.317838:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789130628.317853:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789130628.317860:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9e9b83bdd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789130628.317865:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789130628.317872:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857772928 00000100:00080000:1.0:1789130628.317873:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9e9b83bdd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789130628.317883:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857772928 00000100:00080000:1.0:1789130628.317884:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 560 00000100:00080000:1.0:1789130628.317898:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e9b83bdd800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130628.317925:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789130628.317932:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876038857772928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130628.317936:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b83aebc00 x1876038857773312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1789130628.317950:0:17944:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789130628.318004:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876038857772928:12345-0@lo:400:kworker.0 Request processed in 71us (511us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789130628.318012:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789130628.318041:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857772160 00000100:00100000:0.0:1789130628.318047:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857772160 00000100:00100000:0.0:1789130628.318072:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789130628.318078:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3490f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876038857772160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130628.318322:0:19455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857772416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130628.318401:0:19455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857772416:12345-0@lo:400:kworker.0 Request processed in 651us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130628.318410:0:19455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789130628.318489:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876038857772544:0@lo:400:kworker.0 00000100:00100000:2.0:1789130628.318711:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876038857773312:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789130628.318765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130628.318888:0:17944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857773312 00000100:00100000:1.0:1789130628.318893:0:17944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857773312 00000100:00100000:1.0:1789130628.318926:0:17944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789130628.318932:0:17944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876038857773312:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1789130628.318951:0:17944:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00080000:0.0:1789130628.319278:0:17948:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789130628.319436:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3490f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876038857772160:12345-0@lo:400:kworker.0 Request processed in 1355us (4927us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789130628.319449:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789130628.319575:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857772416:0@lo:400:kworker.0 00000100:00080000:0.0:1789130628.319594:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789130628.319600:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9e9cadadc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789130628.319604:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789130628.319629:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9e9cadadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130628.320187:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 595 00000100:00080000:0.0:1789130628.320270:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e9cadadc000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130628.320403:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359c3c0 x1876038857773440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130628.320443:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876038857772928:0@lo:400:kworker.0 00000100:00100000:2.0:1789130628.320908:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876038857773440:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789130628.320994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130628.321052:0:20743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857773440 00000100:00100000:2.0:1789130628.321059:0:20743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857773440 00000100:00100000:2.0:1789130628.321100:0:20743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789130628.321107:0:20743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1876038857773440:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789130628.321126:0:20743:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789130628.321182:0:20743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1876038857773440:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 74us (189us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789130628.321190:0:20743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789130628.321238:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cadadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130628.321431:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130628.321439:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876038857773440:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1789130628.337951:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9e9b8320d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130628.337965:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 577 00000100:00080000:3.0:1789130628.337979:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e9b8320d000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130628.338033:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb3493c00 x1876038857773568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130628.338081:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876038857772672:0@lo:400:kworker.0 00000100:00100000:2.0:1789130628.338142:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3493c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876038857773568:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789130628.338176:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789130628.338182:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9e9c98e49000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789130628.338187:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789130628.338194:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9e9c98e49000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130628.338199:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 560 00000100:00080000:3.0:1789130628.338205:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e9c98e49000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130628.338223:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb3490b40 x1876038857773696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789130628.338237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130628.338242:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857772160:0@lo:400:kworker.0 00000100:00100000:2.0:1789130628.338307:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857773696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789130628.338341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130628.338413:0:17942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857773568 00000100:00100000:2.0:1789130628.338421:0:17942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857773568 00000100:00100000:2.0:1789130628.338460:0:17942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789130628.338468:0:17942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876038857773568:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789130628.338494:0:17942:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789130628.338537:0:17942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876038857773568:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 68us (306us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789130628.338560:0:17942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789130628.338609:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b8320d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130628.338643:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130628.338647:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3493c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876038857773568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789130628.344900:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857773696 00000100:00100000:3.0:1789130628.344924:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857773696 00000100:00100000:3.0:1789130628.345012:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789130628.345024:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876038857773696:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1789130628.345058:0:17947:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789130628.345217:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876038857773696:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 193us (6876us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789130628.345227:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789130628.345264:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c98e49000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130628.345276:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130628.345281:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857773696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789130628.405147:0:17944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876038857773312:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 86207us (86374us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789130628.405161:0:17944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789130628.411114:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b83bdd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130628.411129:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130628.411134:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876038857773312:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1789130629.098465:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130630.110079:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789130630.372184:0:20270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789130630.372195:0:20270:0:(genops.c:885:class_export_put()) final put ffff9e9b83316800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789130630.372405:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b83316800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789130630.372476:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b83314800 for lustre-OST0001 00000020:01000004:2.0:1789130630.542919:0:21726:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789130630.558580:0:21726:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789130630.558703:0:21726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.558719:0:21726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.558727:0:21726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.558734:0:21726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.558801:0:21726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789130630.558808:0:21726:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789130630.558838:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130630.558843:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789130630.558850:0:21726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789130630.558856:0:21726:0:(import.c:65:import_set_state_nolock()) ffff9e9b83bdd800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789130630.558863:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130630.558880:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789130630.558885:0:21726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789130630.559854:0:21726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.559868:0:21726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.559876:0:21726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.559883:0:21726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565169:0:20979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130630.565186:0:20979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565197:0:20979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb740f000 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130630.565202:0:20979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565213:0:20979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130630.565221:0:20979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130630.565226:0:20979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130630.565230:0:20979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789130630.565233:0:20979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789130630.565281:0:20979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565287:0:20979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130630.565322:0:20979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565329:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb740f000/0x76b2fec9b0508c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508c54 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565345:0:20979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130630.565348:0:20979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565380:0:20979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb740e200 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130630.565384:0:20979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565391:0:20979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130630.565396:0:20979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130630.565401:0:20979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130630.565403:0:20979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1789130630.565417:0:20979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565422:0:20979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130630.565438:0:20979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.565446:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130630.565447:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130630.565449:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130630.565476:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130630.565499:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3643:1876038857773952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130630.565570:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130630.565643:0:19102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857773952 00000100:00100000:1.0:1789130630.565650:0:19102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857773952 00000100:00100000:1.0:1789130630.565684:0:19102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789130630.565691:0:19102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1876038857773952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789130630.565703:0:19102:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789130630 with bad export cookie 8553178784529943160 00000100:00100000:2.0:1789130630.568498:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3645:1876038857773824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130630.568576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130630.571155:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857773824 00000100:00100000:0.0:1789130630.571173:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857773824 00000100:00100000:0.0:1789130630.571232:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130630.571241:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1876038857773824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789130630.571248:0:17929:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789130630 with bad export cookie 8553178784529943160 00000100:00100000:0.0:1789130630.571335:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1876038857773824:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (2758us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789130630.571360:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789130630.571419:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789130630.571424:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9e9c870cd000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789130630.571428:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.110@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1789130630.572658:0:21726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789130630.572673:0:21726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e200/0x76b2fec9b0508bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508bb3 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.572700:0:21726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.572709:0:21726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.572716:0:21726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.572723:0:21726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.572740:0:21726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130630.572769:0:17931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130630.572775:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.572782:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8e00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:3.0:1789130630.572786:0:17931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.572796:0:17931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130630.572804:0:17931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130630.572810:0:17931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789130630.572812:0:17931:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789130630.572814:0:17931:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789130630.573554:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130630.574703:0:21726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574720:0:21726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574727:0:21726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574735:0:21726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574780:0:21726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130630.574788:0:21726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574795:0:21726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574800:0:21726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574806:0:21726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574819:0:21726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789130630.574823:0:21726:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789130630.574829:0:21726:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1789130630.574872:0:17930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130630.574878:0:17930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574886:0:17930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983e00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130630.574889:0:17930:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.574898:0:17930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130630.574905:0:17930:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130630.574920:0:17930:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789130630.574922:0:17930:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789130630.574924:0:17930:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789130630.577857:0:20979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789130630.578090:0:19102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1876038857773952:12345-0@lo:103:ldlm_bl.0 Request processed in 12393us (12514us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789130630.578103:0:19102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789130630.578155:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789130630.599039:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.110@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789130630.599045:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789130630.599055:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb359cb40 x1876038857772032/t0(0) o400->MGC192.168.202.110@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789130644 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130630.599073:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b83aeb0c0 x1876038857773952/t0(0) o103->MGC192.168.202.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789130646 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130630.599082:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9b83ae8f00 x1876038857773824/t0(0) o103->MGC192.168.202.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789130646 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789130630.599093:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789130630.599096:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789130630.599098:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:3.0:1789130630.600722:0:17931:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.600741:0:17931:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130630.600784:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.600793:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9c829d8e00/0x76b2fec9b0508ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b0508ea7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130630.600820:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130630.600822:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130630.600824:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789130630.602123:0:21726:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789130630.602148:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789130630.602156:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130630.602165:0:21726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789130630.602173:0:21726:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9e9b82b65800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789130630.602180:0:21726:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9e9cac288800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789130630.602186:0:21726:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9e9cb4efced8) has exports, disconnecting them 00000020:00080000:3.0:1789130630.602191:0:21726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e9b82b65800), last request at 1789130628 00000020:00000080:3.0:1789130630.602200:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508e92 00000100:00080000:3.0:1789130630.602220:0:21726:0:(import.c:65:import_set_state_nolock()) ffff9e9b82b62000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789130630.602270:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789130630.602283:0:21726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b82b65800): rc 0 00000020:00000080:3.0:1789130630.602285:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9b82b65800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789130630.602301:0:21726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e9cac288800), last request at 1789130628 00000020:00000080:3.0:1789130630.602304:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508d34 00000100:00080000:3.0:1789130630.602310:0:21726:0:(import.c:65:import_set_state_nolock()) ffff9e9cac28d000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789130630.602320:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789130630.602326:0:21726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9cac288800): rc 0 00000020:00000080:3.0:1789130630.602329:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9cac288800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789130630.602336:0:21726:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffade741067ae0 00000100:00080000:3.0:1789130630.602357:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130630.602361:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789130630.605259:0:21726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789130630.605271:0:21726:0:(import.c:65:import_set_state_nolock()) ffff9e9c98e49000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789130630.606223:0:17930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.606236:0:17930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130630.606269:0:17930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.606277:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83983e00/0x76b2fec9b0509036 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x76b2fec9b050903d expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130630.606298:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130630.606300:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130630.606302:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130630.606357:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:0:1876038857774208:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789130630.606445:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e9c870cd000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789130630.606470:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3643:1876038857772032:0@lo:400:kworker.0 00000100:00100000:1.0:1789130630.606488:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:0:1876038857774080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130630.606493:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3643:1876038857773952:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789130630.606514:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82b65800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789130630.606753:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cac288800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789130630.606852:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b82b62000 for lustre-MDT0001 00000020:00000080:1.0:1789130630.606858:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cac28d000 for lustre-MDT0001 00000100:00080000:0.0:1789130630.607272:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9e9c870cd000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130630.607282:0:3645:0:(import.c:510:import_select_connection()) MGC192.168.202.110@tcp: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1789130630.607291:0:3645:0:(import.c:624:import_select_connection()) MGC192.168.202.110@tcp: import ffff9e9c870cd000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130630.607327:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359f840 x1876038857774336/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130630.607364:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3645:1876038857773824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130630.607389:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3641:1876038857774336:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1789130630.607440:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876038857774336 offset 0 length 520: 4 00000100:00080000:3.0:1789130630.607552:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789130630.607556:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789130630.607607:0:21726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789130630.607868:0:21726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:1.0:1789130630.608101:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130630.608111:0:20979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.608122:0:20979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb740e800 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130630.608126:0:20979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.608137:0:20979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130630.608145:0:20979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130630.608159:0:20979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130630.608162:0:20979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789130630.608166:0:20979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789130630.608182:0:20979:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:1.0:1789130630.608186:0:20979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.608192:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e800/0x76b2fec9b0508b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508ba5 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130630.608207:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130630.608209:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130630.608210:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130630.608215:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130630.608217:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130630.608258:0:21726:0:(import.c:65:import_set_state_nolock()) ffff9e9cada53000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789130630.608281:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789130630.608284:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789130630.608294:0:21726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789130630.608362:0:21726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789130630.608383:0:21726:0:(import.c:65:import_set_state_nolock()) ffff9e9c90993000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789130630.608440:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e9cb4efced8) has no exports 00000100:00100000:1.0:1789130630.608536:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857774464:0@lo:9:umount.0 00000100:00100000:1.0:1789130630.608587:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130630.608639:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3493c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857774592:0@lo:9:umount.0 00000100:00100000:1.0:1789130630.608676:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130630.608712:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857774464 00000100:00100000:1.0:1789130630.608719:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857774464 00000100:00100000:0.0:1789130630.608905:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857774592 00000100:00100000:0.0:1789130630.608910:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857774592 00000100:00100000:0.0:1789130630.608947:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130630.608957:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876038857774464:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789130630.608983:0:19456:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508d57 00000100:00080000:0.0:1789130630.609000:0:19456:0:(import.c:65:import_set_state_nolock()) ffff9e9cb3df3800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789130630.609007:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789130630.609018:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876038857774592:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789130630.609034:0:19454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ec3 00000001:00000004:0.0:1789130630.609040:0:19456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00080000:1.0:1789130630.609041:0:19454:0:(import.c:65:import_set_state_nolock()) ffff9e9b82a7e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789130630.609080:0:19454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789130630.609231:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3641:x1876038857774592:12345-0@lo:9:umount.0 Request processed in 214us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130630.609237:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3641:x1876038857774464:12345-0@lo:9:umount.0 Request processed in 281us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130630.609251:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789130630.609278:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130630.609281:0:17938:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130630.609305:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cada53000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1789130630.609609:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130630.609671:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789130630.609842:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789130630.609845:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130630.609850:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857774464:0@lo:9:umount.0 00000100:00080000:1.0:1789130630.609868:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90993000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789130630.609875:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789130630.610071:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789130630.610076:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3493c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857774592:0@lo:9:umount.0 00000100:00100000:0.0:1789130630.615929:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000020:00080000:3.0:1789130630.631831:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e9cb4efced8) has no exports 00000020:01000000:2.0:1789130630.704115:0:21726:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9cbc11dd80 - data ffff9e9b8249cd80/ffff9e9b8333b000 00000020:01000000:2.0:1789130630.704294:0:21726:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9c92658f60 - data ffff9e9c9f149798/ffff9e9c879c9000 00000001:00000004:2.0:1789130630.717735:0:21726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1789130630.773602:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789130630.773629:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789130630.773639:0:21726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789130630.777559:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789130630.777568:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789130630.777635:0:21726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789130630.777652:0:21726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789130630.782240:0:18685:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789130630.782251:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1789130630.782267:0:18685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789130630.787934:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789130630.787944:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789130630.787969:0:21726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789130630.787972:0:21726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789130630.789287:0:18687:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789130630.789295:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1789130630.789322:0:18687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789130630.794341:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508bc1 00000020:00000080:2.0:1789130630.794428:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c88d15000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789130630.794574:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c88d15000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789130630.795329:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508bd6 00000020:00000080:2.0:1789130630.795337:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c82cd1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789130630.795343:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789130630.795471:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c82cd1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1789130630.799203:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130630.799218:0:21726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789130630.799223:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e9cb4efb490) has no exports 00000004:01000000:2.0:1789130630.799414:0:21726:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789130630.799424:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508c2a 00000020:00000080:2.0:1789130630.799435:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9cb3df6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789130630.799460:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789130630.799465:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130630.799470:0:21726:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789130630.799472:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9e9c90d9ced8) has no exports 00000020:00000080:2.0:1789130630.799479:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508c23 00000020:00000080:2.0:1789130630.799483:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c90991800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789130630.799861:0:21726:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789130630.799866:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789130630.799871:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789130630.799877:0:21726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789130630.799881:0:21726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789130630.799911:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789130630.799917:0:21726:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789130630.799923:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508c15 00000020:00000080:2.0:1789130630.799926:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9b842e1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789130630.799929:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789130630.799932:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130630.799943:0:21726:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789130630.799945:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9e9cad8b8000) has no exports 00000020:00000080:2.0:1789130630.799948:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508c07 00000020:00000080:2.0:1789130630.799951:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c88d10000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789130630.800268:0:21726:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789130630.800271:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789130630.800274:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789130630.800278:0:21726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789130630.800279:0:21726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789130630.800301:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789130630.800305:0:21726:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789130630.800320:0:21726:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789130630.800324:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508bf9 00000020:00000080:2.0:1789130630.800329:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9b842e5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789130630.800333:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789130630.800336:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130630.800339:0:21726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789130630.800341:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9e9cb4ef8000) has no exports 00000020:00000080:2.0:1789130630.800345:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508bf2 00000020:00000080:2.0:1789130630.800348:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c88d13000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789130630.801160:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb3df6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789130630.801172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c90991800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789130630.801177:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9c90993000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789130630.801184:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9b842e7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789130630.801187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b842e7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789130630.801191:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789130630.801275:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b842e1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789130630.801282:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c88d10000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789130630.801287:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cada53000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789130630.801291:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9b842e3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789130630.801293:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b842e3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789130630.801296:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789130630.801321:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b842e5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789130630.801326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c88d13000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789130630.804485:0:21726:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1789130630.804496:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130630.804500:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789130630.804509:0:21726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789130630.804578:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130630.804589:0:21726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789130630.804631:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130630.804635:0:21726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789130630.804641:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c8760f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789130630.804646:0:21726:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c8760f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1789130630.804659:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9c98e49000 for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1789130630.804661:0:21726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789130630.804672:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9cada54800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789130630.804676:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cada54800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789130630.804694:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789130630.804844:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508bdd 00000020:00000080:3.0:1789130630.804851:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c82cd0800/lustre-MDD0001_UUID 00000020:01000000:3.0:1789130630.804863:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1789130630.804868:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130630.804898:0:21726:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789130630.804902:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e9cb4ef9a48) has no exports 00000020:00000080:3.0:1789130630.804921:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130630.804925:0:21726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1789130630.804930:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508be4 00000020:00000080:3.0:1789130630.804935:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c82cd7800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1789130630.804944:0:21726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9c8760c000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1789130630.804947:0:21726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9c8760c000 2 00000020:01000004:3.0:1789130630.804950:0:21726:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9c8760c000 from lustre-MDT0001 00000020:00000080:3.0:1789130630.804968:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130630.804971:0:21726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1789130630.804974:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c88d15800/lustre-MDT0001_UUID 00000020:00000080:3.0:1789130630.804976:0:21726:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c88d15800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1789130630.804982:0:21726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1789130630.805011:0:21726:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1789130630.805015:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1789130630.805018:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130630.805021:0:21726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789130630.805027:0:21726:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9e9b83bde000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789130630.805032:0:21726:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9e9cad8b9a48) has exports, disconnecting them 00000020:00080000:3.0:1789130630.805036:0:21726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9e9b83bde000), last request at 1789130541 00000020:00000080:3.0:1789130630.805040:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508c62 00000020:00080000:3.0:1789130630.805050:0:21726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b83bde000): rc 0 00000020:00000080:3.0:1789130630.805053:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9b83bde000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789130630.806169:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c82cd0800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789130630.806187:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9c88d14000/lustre-MDD0001_UUID 00000020:00000080:0.0:1789130630.806190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c88d14000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789130630.806195:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789130630.815014:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c82cd7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789130630.815030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b83bde000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789130630.815149:0:21726:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789130630.815154:0:21726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789130630.815158:0:21726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789130630.815164:0:21726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789130630.815189:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b83bdd800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789130630.815364:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130630.815380:0:21726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789130630.815385:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9cbc276800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789130630.815388:0:21726:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cbc276800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789130630.815397:0:21726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789130630.815446:0:21726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9c8760c000 1 00000020:00000080:0.0:1789130630.815452:0:21726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508b89 00000020:00000080:0.0:1789130630.815459:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c870ce000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789130630.815468:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789130630.815476:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c870ce000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789130630.815485:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789130630.815489:0:21726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789130630.815493:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9e9cb2ed1a48) has no exports 00000020:00000080:0.0:1789130631.041792:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130631.041806:0:21726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789130631.041812:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c8760b800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789130631.041817:0:21726:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c8760b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789130631.041828:0:21726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789130631.041940:0:21726:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e9c87609000 00000020:01000000:0.0:1789130631.041971:0:21726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789130631.041975:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789130631.041980:0:21726:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789130631.041984:0:21726:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e9cb2ed4ed8) has no exports 00000100:00100000:0.0:1789130631.042063:0:17944:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e9c9fa30200:17944] 2 exiting: rc = 0 00000100:00100000:2.0:1789130631.042341:0:17943:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e9c9fa31000:17943] 1 exiting: rc = 0 00000100:00100000:2.0:1789130631.042441:0:17942:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e9c9fa30c00:17942] 0 exiting: rc = 1 00000100:00100000:2.0:1789130631.042680:0:20743:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e9c847b4a00:20743] 3 exiting: rc = 0 00000100:00100000:0.0:1789130631.042918:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042927:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042933:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042941:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042948:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042956:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042962:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042969:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042975:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042982:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042989:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.042995:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043001:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043007:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043012:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043017:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043023:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043029:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043034:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043052:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043060:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043066:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043072:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043077:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043082:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043086:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043091:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043095:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043100:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043105:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043123:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043129:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043134:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043140:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043146:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043152:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043159:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043165:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043171:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043177:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043184:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043190:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043196:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043202:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043207:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043214:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043220:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043225:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043230:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043238:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043245:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043251:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043257:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043262:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043268:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043273:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043279:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043285:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043290:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043296:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043301:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043307:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043312:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.043319:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.064693:0:17946:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e9c9fa31e00:17946] 1 exiting: rc = 0 00000100:00100000:2.0:1789130631.064926:0:17945:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e9cb3dcbc00:17945] 0 exiting: rc = 1 00000100:00100000:0.0:1789130631.065030:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065055:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065076:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065088:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065094:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065099:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065105:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065111:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065117:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065122:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065128:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065134:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065140:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065147:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065152:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065157:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065162:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065167:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065173:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065179:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065185:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065190:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065196:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065203:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065208:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065214:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065218:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065223:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065228:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065234:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065239:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065245:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065250:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065257:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065262:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065268:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065282:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065287:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065293:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065299:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065304:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065311:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065318:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065323:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065335:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065341:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065346:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065352:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065357:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065362:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065378:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065385:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065391:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065396:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065402:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065407:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065412:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065418:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065424:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065429:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065435:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065441:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065447:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065453:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.065925:0:17948:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e9cb4c37800:17948] 1 exiting: rc = 0 00000100:00100000:1.0:1789130631.066351:0:18931:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9e9c844f4a00:18931] 2 exiting: rc = 0 00000100:00100000:2.0:1789130631.066506:0:17947:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e9c914f5200:17947] 0 exiting: rc = 1 00000100:00100000:0.0:1789130631.066994:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067004:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067010:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067017:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067023:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067029:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067049:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067055:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067072:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067079:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067084:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067090:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067096:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067102:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067108:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067115:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067121:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067128:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067134:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067141:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067162:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067170:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067177:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067184:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067191:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067198:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067204:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067211:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067217:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067223:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067229:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067235:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067259:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067269:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067276:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067283:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067290:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067296:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067302:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067308:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067315:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067327:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067333:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067339:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067358:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067365:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067383:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067390:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067396:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067402:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067409:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067418:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067423:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067429:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067435:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.067439:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.068207:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.068219:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.068225:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.068232:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.068239:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.068246:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.068252:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.068259:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789130631.082278:0:17950:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e9c9fb97e00:17950] 1 exiting: rc = 0 00000100:00100000:1.0:1789130631.082439:0:17949:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e9c9fb96800:17949] 0 exiting: rc = 1 00000100:00100000:0.0:1789130631.082817:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082826:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082832:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082839:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082844:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082850:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082856:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082862:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082867:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082872:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082876:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082881:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082901:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082906:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082912:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082918:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082924:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082929:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082935:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082941:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082946:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082950:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082955:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082960:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082966:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082971:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082976:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082981:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082986:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082991:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.082996:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083001:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083006:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083010:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083015:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083021:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083027:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083033:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083039:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083045:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083050:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083056:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083061:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083066:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083071:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083076:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083082:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083098:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083104:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083109:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083114:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083119:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083124:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083129:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083134:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083140:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083145:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083150:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083155:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083161:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083166:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083170:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083176:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.083182:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.084453:0:17952:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e9c91760e00:17952] 1 exiting: rc = 0 00000100:00100000:2.0:1789130631.084869:0:17951:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e9cb3d24200:17951] 0 exiting: rc = 1 00000100:00100000:0.0:1789130631.084963:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.084970:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.084976:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.084982:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.084988:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.084993:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.084999:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085004:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085009:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085015:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085021:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085027:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085032:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085037:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085042:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085048:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085053:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085059:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085075:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085081:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085087:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085093:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085099:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085104:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085109:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085115:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085120:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085125:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085130:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085136:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085141:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085146:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085151:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085156:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085161:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085167:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085172:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085178:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085183:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085190:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085195:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085201:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085207:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085212:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085218:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085223:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085228:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085233:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085238:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085243:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085248:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085252:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085256:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085267:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085272:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085277:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085282:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085286:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085291:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085295:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085300:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085305:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085311:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.085316:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.085807:0:17953:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e9cb3d25c00:17953] 0 exiting: rc = 1 00000100:00100000:2.0:1789130631.085917:0:17954:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e9ca0400200:17954] 1 exiting: rc = 0 00000100:00100000:0.0:1789130631.086002:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086009:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086014:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086019:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086025:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086030:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086035:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086041:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086046:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086051:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086057:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086062:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086067:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086072:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086077:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086083:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086088:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086092:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086097:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086104:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086109:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086113:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086119:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086124:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086138:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086143:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086149:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086154:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086159:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086164:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086168:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086174:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086179:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086184:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086190:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086196:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086201:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086207:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086212:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086217:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086223:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086227:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086233:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086239:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086244:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086249:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086254:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086259:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086265:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086270:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086275:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086281:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086285:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086290:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086294:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086299:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086304:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086309:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086314:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086327:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086332:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086337:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086341:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130631.086346:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.087592:0:17956:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e9b82ad4e00:17956] 1 exiting: rc = 0 00000100:00100000:2.0:1789130631.087964:0:17955:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e9cb2f76200:17955] 0 exiting: rc = 1 00000100:00100000:3.0:1789130631.088309:0:17957:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e9cb3c3f800:17957] 2 exiting: rc = 0 00000100:00100000:1.0:1789130631.088592:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088600:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088607:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088645:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088652:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088658:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088665:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088671:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088677:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088683:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088703:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088710:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088717:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088739:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088746:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088753:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088758:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088764:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088771:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088777:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088783:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088789:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088796:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088802:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088808:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088813:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088819:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088825:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088831:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088837:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088843:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088849:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088855:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088861:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088880:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088886:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088892:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088898:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088904:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088909:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088914:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088919:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088924:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088930:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088935:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088940:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088946:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088951:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088961:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088966:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088972:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088978:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088983:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088989:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088994:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.088999:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.089004:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.089010:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.089029:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.089035:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.089039:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.089044:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.089050:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130631.089056:0:21726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789130631.096806:0:21726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130631.096819:0:21726:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789130631.096825:0:21726:0:(genops.c:885:class_export_put()) final put ffff9e9c870cc800/MDS_uuid 00000020:00000080:1.0:1789130631.096829:0:21726:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c870cc800/MDS_uuid for MDS 00000020:01000000:1.0:1789130631.096835:0:21726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789130631.096982:0:21726:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789130631.136558:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130632.158759:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130633.178436:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130633.435867:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789130633.435878:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130633.435881:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789130633.435885:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789130633.435913:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9b8320d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130633.435921:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1789130633.435926:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789130633.435933:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e9b8320d000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130633.435967:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb3490f00 x1876038857774720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130633.436009:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789130633.436013:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789130633.436015:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9cadadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130633.436018:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1789130633.436021:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789130633.436025:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e9cadadc000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130633.436035:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb3492d00 x1876038857774976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130633.436078:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876038857774720:0@lo:38:kworker.0 00000400:00000100:3.0:1789130633.436135:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857774720 offset 0 length 520: 4 00000100:00100000:3.0:1789130633.436188:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3492d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876038857774976:0@lo:38:kworker.0 00000400:00000100:3.0:1789130633.436207:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857774976 offset 0 length 520: 4 00000100:00100000:3.0:1789130633.436243:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130633.436250:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857774848:0@lo:400:kworker.0 00000400:00000100:3.0:1789130633.436274:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857774848 offset 0 length 224: 4 00000100:00100000:3.0:1789130633.436290:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130633.436301:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857775104:0@lo:400:kworker.0 00000400:00000100:3.0:1789130633.436317:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857775104 offset 0 length 224: 4 00010000:00010000:3.0:1789130634.201813:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130635.224954:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789130635.498662:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130635.498688:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130635.498691:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130635.498694:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130635.498755:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130635.498759:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789130635.498898:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876038857775232:0@lo:400:kworker.0 00000400:00000100:1.0:1789130635.498957:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857775232 offset 0 length 224: 4 00000100:00100000:1.0:1789130635.499025:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130635.499034:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857775360:0@lo:400:kworker.0 00000400:00000100:1.0:1789130635.499053:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857775360 offset 0 length 224: 4 00000020:01000004:2.0:1789130635.716538:0:21927:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789130635.732868:0:21927:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789130635.732926:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130635.732942:0:21927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130635.732950:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130635.732957:0:21927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130635.732985:0:21927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789130635.732991:0:21927:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789130635.733021:0:21927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789130635.733033:0:21927:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb3490f00 x1876038857774720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789130648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130635.733060:0:21927:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789130635.733067:0:21927:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789130635.733073:0:21927:0:(import.c:65:import_set_state_nolock()) ffff9e9b8320d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789130635.733092:0:21927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789130635.733096:0:21927:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb3490f00 x1876038857774720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789130648 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130635.733103:0:21927:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789130635.733106:0:21927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1789130635.733435:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876038857774720:0@lo:38:kworker.0 00010000:00010000:1.0:1789130635.733783:0:21727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130635.733791:0:21727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130635.733814:0:21727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e200 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130635.733818:0:21727:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130635.733827:0:21727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130635.733833:0:21727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130635.733838:0:21727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130635.733840:0:21727:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789130635.733844:0:21727:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789130635.733857:0:21727:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:1.0:1789130635.733861:0:21727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130635.733867:0:21727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b8402e200/0x76b2fec9b0508cfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508d03 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130635.733878:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130635.733880:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130635.733882:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789130635.735803:0:21927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789130635.735819:0:21927:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb34912c0 x1876038857774848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130649 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130635.735843:0:21927:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2c780 x1876038857775232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130651 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130635.735858:0:21927:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789130635.735864:0:21927:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789130635.735888:0:21927:0:(import.c:65:import_set_state_nolock()) ffff9e9b8320a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789130635.735916:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876038857775232:0@lo:400:kworker.0 00000100:00100000:0.0:1789130635.735938:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876038857775488:0@lo:39:umount.0 00000100:00100000:3.0:1789130635.735980:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857774848:0@lo:400:kworker.0 00000400:00000100:0.0:1789130635.735992:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857775488 offset 0 length 224: 4 00000001:00100000:2.0:1789130635.994874:0:20270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789130635.994882:0:20270:0:(genops.c:885:class_export_put()) final put ffff9e9b82a7a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789130635.994971:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82a7a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789130635.995020:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b82a7e000 for lustre-OST0001 00000001:00100000:1.0:1789130635.995182:0:19450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789130635.995187:0:19450:0:(genops.c:885:class_export_put()) final put ffff9e9cb3df2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789130635.995295:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb3df2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789130635.995336:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cb3df3800 for lustre-OST0000 00010000:00010000:2.0:1789130636.251391:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130637.273947:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130638.298607:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789130638.552737:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130638.552749:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130638.552753:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130638.552756:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789130638.552865:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857775616:0@lo:400:kworker.0 00000400:00000100:1.0:1789130638.553098:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857775616 offset 0 length 224: 4 00010000:00010000:1.0:1789130639.321339:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130640.346910:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130640.856738:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130630/real 1789130630] req@ffff9e9cb359f840 x1876038857774336/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789130640 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130640.856773:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb359f840 x1876038857774336/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789130640 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789130640.856795:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c870cd000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130640.856828:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789130640.856832:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3641:1876038857774336:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1789130640.856926:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130640.856931:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789130640.856934:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c870cd000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789130640.856954:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.110@tcp: connect to NID 0@lo last attempt 649 00000100:00080000:2.0:1789130640.856960:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.110@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789130640.856967:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.110@tcp: import ffff9e9c870cd000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130640.856997:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2f840 x1876038857775744/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130640.857023:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130640.857026:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789130640.857128:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130640.857152:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857775872:0@lo:400:kworker.0 00000400:00000100:1.0:1789130640.857204:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857775872 offset 0 length 224: 4 00000100:00100000:0.0:1789130640.857876:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3641:1876038857775744:0@lo:250:kworker.0 00000400:00000100:0.0:1789130640.857904:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876038857775744 offset 0 length 520: 4 00010000:00010000:3.0:1789130641.368863:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130642.393005:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130643.417876:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130644.440789:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130645.465201:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130645.976741:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130635/real 1789130635] req@ffff9e9cb4e2d2c0 x1876038857775488/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789130645 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130645.976782:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb4e2d2c0 x1876038857775488/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789130645 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789130645.976803:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b8320a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789130645.976826:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876038857775488:0@lo:39:umount.0 00000100:00080000:2.0:1789130645.976932:0:21927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789130645.976938:0:21927:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789130645.976944:0:21927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789130645.978058:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130645.979801:0:21927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130645.979821:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130645.979829:0:21927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130645.979866:0:21927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130645.979877:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130645.979884:0:21927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130645.979905:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130645.979911:0:21927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130645.979932:0:21927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789130645.979937:0:21927:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789130645.979976:0:21927:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789130645.979980:0:21927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789130645.979987:0:21927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130645.979993:0:21927:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789130645.979998:0:21927:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9e9b841b3490) has no exports 00010000:00010000:3.0:1789130645.980206:0:20979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789130645.980224:0:20979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130645.980241:0:20979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983600 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:3.0:1789130645.980245:0:20979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130645.980254:0:20979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130645.980263:0:20979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130645.980268:0:20979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789130645.980271:0:20979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789130645.980274:0:20979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789130645.980289:0:20979:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:3.0:1789130645.980293:0:20979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130645.980300:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83983600/0x76b2fec9b0508cd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508cd9 expref: -99 pid: 19449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130645.980323:0:20979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130645.980327:0:20979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130645.980332:0:20979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb740fc00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:3.0:1789130645.980335:0:20979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130645.980342:0:20979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130645.980349:0:20979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130645.980354:0:20979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789130645.980356:0:20979:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789130645.980358:0:20979:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789130645.980364:0:20979:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:3.0:1789130645.980367:0:20979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130645.980374:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb740fc00/0x76b2fec9b0509028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b050902f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130645.980383:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130645.980384:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130645.980386:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130645.980443:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789130645.980574:0:21927:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9e9b841b3490) has no exports 00000020:01000000:2.0:1789130645.983798:0:21927:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9b83374cc0 - data ffff9e9c9f19a288/ffff9e9cbcc70800 00000020:01000000:2.0:1789130645.983980:0:21927:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9b84a899c0 - data ffff9e9ca0afcd80/ffff9e9b8427f800 00100000:10000000:2.0:1789130645.999748:0:21927:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789130646.031088:0:21927:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508ce7 00000020:00000080:1.0:1789130646.031102:0:21927:0:(genops.c:885:class_export_put()) final put ffff9e9b82a78000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789130646.031121:0:21927:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b82a92000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789130646.031125:0:21927:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b82a92000 2 00000020:01000004:1.0:1789130646.031128:0:21927:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9b82a92000 from lustre-OST0000 00000020:00000080:1.0:1789130646.031160:0:21927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130646.031169:0:21927:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789130646.031172:0:21927:0:(genops.c:885:class_export_put()) final put ffff9e9cadadf800/lustre-OST0000_UUID 00000020:00000080:1.0:1789130646.031175:0:21927:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cadadf800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789130646.031184:0:21927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789130646.031244:0:21927:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789130646.031249:0:21927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789130646.031253:0:21927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130646.031258:0:21927:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789130646.031271:0:21927:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e9b8320f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789130646.031277:0:21927:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9e9b830b4ed8) has exports, disconnecting them 00000020:00080000:1.0:1789130646.031282:0:21927:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e9b8320f000), last request at 1789130558 00000020:00000080:1.0:1789130646.031286:0:21927:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508d11 00000020:00080000:1.0:1789130646.031295:0:21927:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b8320f000): rc 0 00000020:00000080:1.0:1789130646.031300:0:21927:0:(genops.c:885:class_export_put()) final put ffff9e9b8320f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789130646.031933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82a78000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789130646.031947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b8320f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789130646.033013:0:21927:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789130646.033021:0:21927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789130646.033025:0:21927:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789130646.033032:0:21927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789130646.033202:0:21927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789130646.033210:0:21927:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789130646.033216:0:21927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789130646.033221:0:21927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130646.033225:0:21927:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789130646.033240:0:21927:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9e9b8320e800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130646.033246:0:21927:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9e9b830b3490) has exports, disconnecting them 00000020:00080000:2.0:1789130646.033258:0:21927:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9e9b8320e800), last request at 1789130558 00000020:00000080:2.0:1789130646.033263:0:21927:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508d26 00000020:00080000:2.0:1789130646.033275:0:21927:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b8320e800): rc 0 00000020:00000080:2.0:1789130646.033280:0:21927:0:(genops.c:885:class_export_put()) final put ffff9e9b8320e800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789130646.033737:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b8320d000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789130646.033746:0:36:0:(genops.c:885:class_export_put()) final put ffff9e9cbff3a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789130646.033749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cbff3a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789130646.033755:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789130646.033816:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b8320e800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789130646.056979:0:21927:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789130646.056989:0:21927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789130646.056993:0:21927:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789130646.057008:0:21927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789130646.057042:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b8320a800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789130646.057235:0:21927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130646.057245:0:21927:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789130646.057250:0:21927:0:(genops.c:885:class_export_put()) final put ffff9e9b8320f800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789130646.057254:0:21927:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b8320f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789130646.057266:0:21927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789130646.057337:0:21927:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b82a92000 1 00000020:00000080:3.0:1789130646.057344:0:21927:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508cc4 00000020:00000080:3.0:1789130646.057349:0:21927:0:(genops.c:885:class_export_put()) final put ffff9e9c8472d000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789130646.057359:0:21927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789130646.057367:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c8472d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789130646.057377:0:21927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130646.057381:0:21927:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789130646.057384:0:21927:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9e9cb3be9a48) has no exports 00000020:00000080:3.0:1789130646.097371:0:21927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130646.097384:0:21927:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789130646.097390:0:21927:0:(genops.c:885:class_export_put()) final put ffff9e9cb2e9d800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789130646.097395:0:21927:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb2e9d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789130646.097406:0:21927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789130646.097722:0:21927:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e9b82a97000 00000020:02000400:3.0:1789130646.097784:0:21927:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1789130646.233432:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789130646.233443:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130646.233446:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789130646.233449:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789130646.233592:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857776000:0@lo:400:kworker.0 00000400:00000100:1.0:1789130646.233697:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857776000 offset 0 length 224: 4 00010000:00010000:2.0:1789130646.489797:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130647.514465:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130648.025098:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130633/real 1789130633] req@ffff9e9cb3492d00 x1876038857774976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789130648 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130648.025135:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb3492d00 x1876038857774976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789130648 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789130648.025156:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cadadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130648.025280:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789130648.025285:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3492d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876038857774976:0@lo:38:kworker.0 00000100:00080000:2.0:1789130648.030434:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130648.030444:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130648.030447:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130648.030451:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789130648.030456:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9cadadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789130648.030464:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 652 00000100:00080000:2.0:1789130648.030471:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789130648.030479:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e9cadadc000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130648.030527:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2f480 x1876038857776128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130648.030604:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876038857776128:0@lo:38:kworker.0 00000400:00000100:0.0:1789130648.030692:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857776128 offset 0 length 520: 4 00000100:00100000:3.0:1789130648.034848:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876038857776256:0@lo:400:kworker.0 00000400:00000100:3.0:1789130648.034925:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857776256 offset 0 length 224: 4 00010000:00010000:3.0:1789130648.537403:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1789130649.304803:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130633/real 1789130633] req@ffff9e9cb3491680 x1876038857775104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789130649 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130649.349767:0:3643:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e9cb3491680 x1876038857775104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789130649 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789130649.349783:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9e9b82b63000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789130649.349788:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789130649.371734:0:3643:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1789130649.373836:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857775104:0@lo:400:kworker.0 00000100:00080000:2.0:1789130649.374056:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130649.374061:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130649.374064:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130649.374067:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130649.374070:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789130649.374073:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789130649.374076:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9b82b63000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789130649.374082:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 595 00000100:00080000:2.0:1789130649.374090:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e9b82b63000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130649.374137:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2ed00 x1876038857776384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130649.375367:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876038857776384:0@lo:38:kworker.0 00000400:00000100:1.0:1789130649.375432:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876038857776384 offset 0 length 520: 4 00010000:00010000:1.0:1789130649.580384:0:21727:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789130650.187530:0:22129:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789130650.198831:0:22129:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789130650.198915:0:22129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.198930:0:22129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.198937:0:22129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.198944:0:22129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.198968:0:22129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789130650.198974:0:22129:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789130650.198999:0:22129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789130650.199023:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2f480 x1876038857776128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789130668 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.199039:0:22129:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789130650.199073:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cadadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130650.199077:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1789130650.199081:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876038857776128:0@lo:38:kworker.0 00000100:00080000:1.0:1789130650.199108:0:22129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789130650.199113:0:22129:0:(import.c:65:import_set_state_nolock()) ffff9e9cadadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789130650.199118:0:22129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789130650.199120:0:22129:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789130650.199123:0:22129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789130650.199742:0:17930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130650.199751:0:17930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130650.199759:0:17930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9600 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130650.199763:0:17930:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130650.199774:0:17930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130650.199780:0:17930:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130650.199786:0:17930:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789130650.199789:0:17930:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789130650.199792:0:17930:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789130650.199808:0:17930:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:2.0:1789130650.199812:0:17930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130650.199819:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9c829d9600/0x76b2fec9b0508e61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508e68 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130650.199832:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130650.199833:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130650.199835:0:17930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789130650.201249:0:22129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789130650.201266:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2e1c0 x1876038857775360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130651 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201288:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2c000 x1876038857775616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130654 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201296:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2c780 x1876038857775872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130656 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201306:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb34912c0 x1876038857776000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130662 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201314:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2da40 x1876038857776256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201323:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2ed00 x1876038857776384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789130659 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201334:0:22129:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789130650.201374:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857775616:0@lo:400:kworker.0 00000100:00100000:1.0:1789130650.201398:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857775360:0@lo:400:kworker.0 00000100:00080000:1.0:1789130650.201438:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b82b63000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130650.201442:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1789130650.201445:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876038857776384:0@lo:38:kworker.0 00000100:00080000:1.0:1789130650.201464:0:22129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789130650.201468:0:22129:0:(import.c:65:import_set_state_nolock()) ffff9e9b82b63000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789130650.201474:0:22129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789130650.201478:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2c780 x1876038857775872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130656 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201486:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb34912c0 x1876038857776000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130662 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201493:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2da40 x1876038857776256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130664 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130650.201499:0:22129:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789130650.201502:0:22129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1789130650.201590:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857776000:0@lo:400:kworker.0 00000100:00100000:3.0:1789130650.201609:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857775872:0@lo:400:kworker.0 00000100:00100000:3.0:1789130650.201666:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876038857776256:0@lo:400:kworker.0 00010000:00010000:0.0:1789130650.204162:0:22129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130650.204185:0:22129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130650.204204:0:22129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130650.204211:0:22129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130650.204268:0:22129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130650.204278:0:22129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130650.204285:0:22129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130650.204292:0:22129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130650.204297:0:22129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.204344:0:17931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130650.204351:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.204358:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a93c00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130650.204361:0:17931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.204370:0:17931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130650.204376:0:17931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130650.204389:0:17931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789130650.204391:0:17931:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789130650.204403:0:17931:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:1.0:1789130650.204406:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.204413:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b0508e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508e3e expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.204426:0:17931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130650.204429:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.204434:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402ee00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130650.204436:0:17931:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.204441:0:17931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130650.204446:0:17931:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130650.204450:0:17931:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789130650.204452:0:17931:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789130650.204455:0:17931:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:1.0:1789130650.204457:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130650.204473:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130650.204474:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130650.204476:0:17931:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130650.204544:0:22129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789130650.204550:0:22129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b8402ee00/0x76b2fec9b050901a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0509021 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130650.204563:0:22129:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789130650.204568:0:22129:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789130650.204570:0:22129:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789130650.204594:0:22129:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789130650.204598:0:22129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789130650.204603:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789130650.204608:0:22129:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789130650.204658:0:22129:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9e9b830b1a48) has no exports 00000020:00080000:0.0:1789130650.204769:0:22129:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9e9b830b1a48) has no exports 00000020:01000000:0.0:1789130650.206506:0:22129:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9cbcc68ea0 - data ffff9e9ca0af2ca8/ffff9e9cb3465800 00000020:01000000:0.0:1789130650.206691:0:22129:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9e9cbcc68300 - data ffff9e9b8249f870/ffff9e9cb3466000 00010000:00010000:3.0:1789130650.207995:0:20979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789130650.223271:0:22129:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789130650.240835:0:22129:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508e4c 00000020:00000080:3.0:1789130650.240852:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9cbff3b000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789130650.243593:0:22129:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9cbc276000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789130650.243635:0:22129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9cbc276000 2 00000020:01000004:3.0:1789130650.243817:0:22129:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e9cbc276000 from lustre-OST0001 00000020:00000080:3.0:1789130650.243867:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130650.243878:0:22129:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789130650.243884:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9cb3df4800/lustre-OST0001_UUID 00000020:00000080:3.0:1789130650.243887:0:22129:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cb3df4800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789130650.243896:0:22129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789130650.244015:0:22129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a3345e3c-72dd-4a08-a1e2-d786a027f7a0->MGS 00010000:00010000:3.0:1789130650.244031:0:22129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb740ec00/0x76b2fec9b0508b90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508b97 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130650.244044:0:22129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740ec00/0x76b2fec9b0508b90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508b97 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130650.244050:0:22129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789130650.244052:0:22129:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789130650.244056:0:22129:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789130650.244073:0:22129:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:3.0:1789130650.244076:0:22129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb740ec00/0x76b2fec9b0508b90 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508b97 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130650.244092:0:22129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e000/0x76b2fec9b0508a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x76b2fec9b0508a86 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130650.244098:0:22129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e000/0x76b2fec9b0508a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x76b2fec9b0508a86 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130650.244103:0:22129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789130650.244105:0:22129:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789130650.244106:0:22129:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789130650.244114:0:22129:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e9c870cd000 00010000:00010000:3.0:1789130650.244117:0:22129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb740e000/0x76b2fec9b0508a7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x76b2fec9b0508a86 expref: -99 pid: 17921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130650.244141:0:22129:0:(import.c:65:import_set_state_nolock()) ffff9e9c870cd000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789130650.244145:0:22129:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789130650.244147:0:22129:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789130650.244149:0:22129:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789130650.244153:0:22129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789130650.244164:0:22129:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e9cb4e2f840 x1876038857775744/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789130655 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789130650.244196:0:22129:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789130650.244199:0:22129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1789130650.244421:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3345e3c-72dd-4a08-a1e2-d786a027f7a0:3641:1876038857775744:0@lo:250:kworker.0 10000000:01000000:3.0:1789130650.246891:0:22129:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789130650.246913:0:22129:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508a6a 00000020:00000080:3.0:1789130650.246934:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9c870c8800/a3345e3c-72dd-4a08-a1e2-d786a027f7a0 00000020:00000080:2.0:1789130650.248034:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cbff3b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789130650.250843:0:22129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.110@tcp (flags='') 00000020:00000080:3.0:1789130650.250858:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130650.250867:0:22129:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.110@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789130650.250872:0:22129:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e9cb2ed3490) has no exports 00000020:00000080:2.0:1789130650.251248:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c870c8800/a3345e3c-72dd-4a08-a1e2-d786a027f7a0 for MGC192.168.202.110@tcp 10000000:01000000:1.0:1789130650.256454:0:17939:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789130650.259092:0:22129:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.110@tcp: client import never connected 00000100:00080000:2.0:1789130650.259101:0:22129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789130650.259105:0:22129:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789130650.259110:0:22129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789130650.259114:0:22129:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789130650.259216:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789130650.259227:0:22129:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.110@tcp (uuid a3345e3c-72dd-4a08-a1e2-d786a027f7a0) 00000020:01000000:2.0:1789130650.259235:0:22129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789130650.259242:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789130650.259247:0:22129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789130650.259256:0:22129:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e9b83bda000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789130650.259263:0:22129:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9e9cb3d4ced8) has exports, disconnecting them 00000020:00080000:2.0:1789130650.259267:0:22129:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e9b83bda000), last request at 1789130576 00000020:00000080:2.0:1789130650.259272:0:22129:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508e76 00000020:00080000:2.0:1789130650.259289:0:22129:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b83bda000): rc 0 00000020:00000080:2.0:1789130650.259296:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9b83bda000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789130650.259318:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9c870cd000 for MGC192.168.202.110@tcp 00000020:00000080:3.0:1789130650.259384:0:12461:0:(genops.c:885:class_export_put()) final put ffff9e9c870cf000/a3345e3c-72dd-4a08-a1e2-d786a027f7a0 00000020:00000080:3.0:1789130650.259388:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c870cf000/a3345e3c-72dd-4a08-a1e2-d786a027f7a0 for MGC192.168.202.110@tcp 00000020:01000000:3.0:1789130650.259400:0:12461:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.110@tcp (a3345e3c-72dd-4a08-a1e2-d786a027f7a0) 00000020:00000080:3.0:1789130650.263770:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b83bda000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789130650.265231:0:22129:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789130650.265239:0:22129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789130650.265243:0:22129:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789130650.265250:0:22129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789130650.265443:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789130650.265452:0:22129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789130650.265459:0:22129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789130650.265465:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789130650.265482:0:22129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789130650.265489:0:22129:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9e9b83317000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789130650.265496:0:22129:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9e9b830b0000) has exports, disconnecting them 00000020:00080000:3.0:1789130650.265501:0:22129:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9e9b83317000), last request at 1789130576 00000020:00000080:3.0:1789130650.265505:0:22129:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508e8b 00000020:00080000:3.0:1789130650.265521:0:22129:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e9b83317000): rc 0 00000020:00000080:3.0:1789130650.265527:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9b83317000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789130650.266222:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9cadadc000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789130650.266232:0:12461:0:(genops.c:885:class_export_put()) final put ffff9e9cbc270800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789130650.266235:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cbc270800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789130650.266249:0:12461:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789130650.266325:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b83317000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789130650.298766:0:22129:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789130650.298776:0:22129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789130650.298780:0:22129:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789130650.298788:0:22129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789130650.298821:0:12461:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e9b82b63000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789130650.298870:0:21727:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789130650.300911:0:17930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789130650.301156:0:17931:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1789130650.301354:0:20979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789130650.301544:0:17926:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e9b8437b200:17926] 1 exiting: rc = 0 00000100:00100000:1.0:1789130650.302747:0:17925:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e9b820ca400:17925] 0 exiting: rc = 1 00000100:00100000:1.0:1789130650.302853:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.303161:0:17927:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e9b820cb200:17927] 0 exiting: rc = 1 00000100:00100000:1.0:1789130650.303263:0:19102:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e9b8437a200:19102] 3 exiting: rc = 0 00000100:00100000:0.0:1789130650.303689:0:17928:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e9b820ca600:17928] 1 exiting: rc = 0 00000100:00100000:0.0:1789130650.303758:0:17929:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e9b820ca800:17929] 2 exiting: rc = 0 00000100:00100000:1.0:1789130650.306568:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306582:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306588:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306593:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306601:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306708:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306714:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306720:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306725:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306731:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306736:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306742:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306747:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306753:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306758:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306764:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306769:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306775:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306779:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306784:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306789:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306794:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306799:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306803:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306808:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306813:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306818:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306823:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306827:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306833:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306838:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306844:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306849:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306853:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306858:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306863:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306867:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306873:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306877:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306882:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306896:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306901:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306906:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306911:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306969:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306977:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306983:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306988:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306993:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.306998:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307003:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307008:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307012:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307017:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307022:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307026:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307031:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307036:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307040:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307046:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307051:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307056:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307060:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.307066:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789130650.308838:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789130650.308850:0:22129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789130650.308856:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9b82b63800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789130650.308861:0:22129:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b82b63800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789130650.308868:0:22129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789130650.308922:0:22129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9cbc276000 1 00000020:00000080:1.0:1789130650.308928:0:22129:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x76b2fec9b0508e30 00000020:00000080:1.0:1789130650.308934:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9b8320c000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789130650.308946:0:22129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789130650.308956:0:12461:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9b8320c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789130650.308976:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789130650.308981:0:22129:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789130650.308985:0:22129:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9e9cad8bb490) has no exports 00000020:00000080:0.0:1789130650.392234:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130650.392248:0:22129:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789130650.392254:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9cbc271000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789130650.392258:0:22129:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9cbc271000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789130650.392268:0:22129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789130650.394812:0:22129:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e9cbc273000 00000020:01000000:0.0:1789130650.394860:0:22129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789130650.394871:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789130650.394877:0:22129:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789130650.394882:0:22129:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9e9cb3beb490) has no exports 00000020:00000080:0.0:1789130650.394916:0:22129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789130650.394938:0:22129:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789130650.394944:0:22129:0:(genops.c:885:class_export_put()) final put ffff9e9c8472a800/OSS_uuid 00000020:00000080:0.0:1789130650.394947:0:22129:0:(genops.c:844:class_export_destroy()) destroying export ffff9e9c8472a800/OSS_uuid for OSS 00000020:01000000:0.0:1789130650.394954:0:22129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789130650.395052:0:19456:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e9c8336ee00:19456] 2 exiting: rc = 0 00000100:00080000:3.0:1789130650.395230:0:17938:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789130650.395355:0:19783:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e9c8794e000:19783] 3 exiting: rc = 0 00000100:00100000:2.0:1789130650.395452:0:19455:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e9c8465a400:19455] 1 exiting: rc = 0 00000100:00100000:2.0:1789130650.395678:0:19454:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e9b8308c400:19454] 0 exiting: rc = 1 00000100:00100000:0.0:1789130650.395813:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395822:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395826:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395831:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395836:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395841:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395846:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395851:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395856:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395861:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395866:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395871:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395876:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395880:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395886:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395890:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395896:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395901:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395906:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395910:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395915:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395920:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395925:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395931:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395936:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395940:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395945:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395952:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395957:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395962:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395977:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395982:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395987:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395992:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.395998:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396003:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396009:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396014:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396020:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396026:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396031:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396036:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396042:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396046:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396052:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396063:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396070:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396074:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396079:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396084:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396089:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396094:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396099:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396104:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396109:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396114:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396119:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396125:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396130:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396135:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396140:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396145:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396149:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.396154:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130650.397319:0:19458:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e9b8407b200:19458] 1 exiting: rc = 0 00000100:00100000:1.0:1789130650.397465:0:19457:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e9c847f1a00:19457] 0 exiting: rc = 1 00000100:00100000:0.0:1789130650.397542:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397557:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397561:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397566:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397571:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397576:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397581:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397586:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397591:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397596:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397600:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397606:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397777:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397786:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397792:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397797:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397803:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397808:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397812:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397817:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397823:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397829:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397838:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397843:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397849:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397855:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397860:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397865:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397870:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397875:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397880:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397885:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397904:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397911:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397916:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397921:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397933:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397939:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397944:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397948:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397953:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397958:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397963:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397968:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397973:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397978:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397982:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397988:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397994:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.397999:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398004:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398009:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398015:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398020:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398026:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398030:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398035:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398041:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398046:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398051:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398055:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398060:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398067:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789130650.398073:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130650.399267:0:19460:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e9c844f3800:19460] 1 exiting: rc = 0 00000100:00100000:1.0:1789130650.399656:0:19459:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e9c844f3600:19459] 0 exiting: rc = 1 00000100:00100000:3.0:1789130650.399881:0:19461:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e9c844f5400:19461] 2 exiting: rc = 0 00000100:00100000:1.0:1789130650.399971:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.399980:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.399987:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.399994:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400000:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400006:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400013:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400019:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400026:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400032:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400037:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400043:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400049:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400054:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400060:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400067:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400086:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400093:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400099:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400102:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400106:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400109:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400113:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400117:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400121:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400124:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400128:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400131:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400135:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400150:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400154:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400158:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400162:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400166:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400169:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400173:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400194:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400200:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400206:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400212:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400235:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400243:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400248:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400253:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400258:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400262:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400267:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400271:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400277:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400282:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400288:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400292:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400297:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400302:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400308:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400313:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400318:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400323:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400328:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400334:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400340:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400346:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400351:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.400357:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789130650.403234:0:19462:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e9c844f5600:19462] 0 exiting: rc = 1 00000100:00100000:2.0:1789130650.403953:0:19463:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e9c844f5000:19463] 1 exiting: rc = 0 00000100:00100000:1.0:1789130650.404011:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404022:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404056:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404063:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404069:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404083:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404107:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404113:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404118:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404123:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404129:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404134:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404138:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404144:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404149:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404154:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404160:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404165:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404170:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404176:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404181:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404197:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404204:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404209:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404215:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404220:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404225:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404231:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404236:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404241:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404247:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404251:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404256:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404261:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404266:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404284:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404289:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404294:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404299:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404304:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404309:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404314:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404320:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404324:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404330:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404336:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404340:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404346:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404351:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404356:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404360:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404364:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404369:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404374:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404378:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404384:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404388:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404394:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404399:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404405:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404409:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404414:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404420:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.404425:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.406392:0:19464:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e9c87a81600:19464] 0 exiting: rc = 1 00000100:00100000:0.0:1789130650.412003:0:19465:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e9c87a81800:19465] 1 exiting: rc = 0 00000100:00100000:1.0:1789130650.412126:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412158:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412165:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412171:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412195:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412218:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412225:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412230:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412237:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412242:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412247:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412253:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412261:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412292:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412299:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412306:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412312:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412318:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412324:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412330:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412336:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412341:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412347:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412352:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412359:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412378:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412567:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412573:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412579:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412584:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412590:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412595:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412601:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412607:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412634:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412708:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412716:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412738:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412745:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412751:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412763:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412768:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412774:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412779:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412786:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412794:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412801:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412808:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412816:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412837:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412843:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412848:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412853:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412859:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412865:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412870:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412875:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412881:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412886:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412891:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412897:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412902:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412908:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789130650.412914:0:22129:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789130650.422914:0:22129:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789130672.490465:0:22895:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789130684.691329:0:23494:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789130684.691335:0:23494:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789130684.691337:0:23494:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789130684.691445:0:23494:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9cb353d000 00000020:01000004:0.0:1789130684.691461:0:23494:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789130684.691469:0:23494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789130684.691491:0:23494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e9cad8bb490) 00000020:00000080:0.0:1789130684.691509:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789130684.728128:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.728949:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789130684.731475:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789130684.732748:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.732991:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.733306:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.733517:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.733829:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.734425:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.734663:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.734837:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.735025:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.735188:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.735582:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.735893:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.736135:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.736433:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.736680:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.737424:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.738507:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.738844:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.739056:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.739232:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.740275:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.740602:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.744024:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.745228:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.745529:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.745820:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.746051:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.746274:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.746454:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.746649:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.746820:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789130684.747013:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789130684.748542:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1789130684.749291:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789130684.750135:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789130684.750406:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789130684.751056:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789130684.751445:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1789130684.753059:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789130684.753533:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789130684.753829:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789130684.754147:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789130684.754541:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789130684.754796:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1789130684.756564:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1789130684.757700:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789130684.757983:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789130684.758556:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789130684.758854:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789130684.759078:0:23494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1789130684.759802:0:23494:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789130684.760050:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789130684.760058:0:23494:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789130684.760072:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76b2fec9b0509370 00000020:01000004:1.0:1789130684.760079:0:23494:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789130684.760084:0:23494:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789130684.760089:0:23494:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9cb353d000 from MGS 00000020:01000004:1.0:1789130684.760093:0:23494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789130684.760105:0:23494:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e9b841b3490) 00000020:00000080:1.0:1789130684.760116:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789130684.762417:0:23494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9cb353d000 from MGS, refs=2 00080000:01000000:1.0:1789130684.762433:0:23494:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789130684.762446:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76b2fec9b050937e 00000100:00100000:1.0:1789130684.762600:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789130684.762777:0:23494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789130684.762783:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789130684.765936:0:23494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789130684.765948:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789130684.766763:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130684.767103:0:23494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789130684.767110:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789130684.782421:0:23494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789130684.782447:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789130684.782997:0:23494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789130684.783005:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789130684.784169:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130684.784173:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130684.784175:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130684.785013:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130684.785017:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130684.785019:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130684.785838:0:23494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789130684.787282:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789130684.796089:0:23494:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789130684.803988:0:23506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789130684.804113:0:23494:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789130684.804178:0:23494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789130684.805190:0:23494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789130684.805495:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130684.806237:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789130684.806244:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789130684.807073:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789130684.807082:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789130684.809992:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789130684.810011:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789130684.811526:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789130684.811552:0:23494:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.110@tcp' 00000020:01000004:1.0:1789130684.811554:0:23494:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789130684.811598:0:23494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.110@tcp (typ=mgc) 00000100:00080000:3.0:1789130684.812130:0:23511:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1789130684.812190:0:23494:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.110@tcp (ffff9e9b841b1a48) 00000020:00000080:1.0:1789130684.812211:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789130684.812296:0:23494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9cb3534800@MGC192.168.202.110@tcp: add connection 192.168.202.110@tcp at head 00010000:00010000:1.0:1789130684.812449:0:23494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.110@tcp-0 is initialized 00000040:01000000:1.0:1789130684.812455:0:23494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789130684.827831:0:23512:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789130684.827976:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.110@tcp (uuid 1eafa3d0-ec8d-483b-8029-cb6f866d8e8e) 00000020:00000080:1.0:1789130684.828029:0:23494:0:(genops.c:1385:class_connect()) connect: client 1eafa3d0-ec8d-483b-8029-cb6f866d8e8e, cookie 0x76b2fec9b050938c 00000100:00080000:1.0:1789130684.828056:0:23494:0:(import.c:510:import_select_connection()) MGC192.168.202.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130684.828062:0:23494:0:(import.c:624:import_select_connection()) MGC192.168.202.110@tcp: import ffff9e9cb3534800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1789130684.828098:0:23494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b83ae9e00 x1876038857776512/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130684.828129:0:23494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1eafa3d0-ec8d-483b-8029-cb6f866d8e8e->MGS 00000020:01000004:1.0:1789130684.828197:0:23494:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789130684.828203:0:23494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789130684.828227:0:23494:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e9b841b0000) 00000020:00000080:1.0:1789130684.828241:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789130684.828661:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3641:1876038857776512:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789130684.828755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130684.828827:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857776512 00000100:00100000:2.0:1789130684.828834:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857776512 00000100:00100000:2.0:1789130684.828872:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130684.828879:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1876038857776512:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789130684.828904:0:23508:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 1eafa3d0-ec8d-483b-8029-cb6f866d8e8e@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:2.0:1789130684.841478:0:23508:0:(genops.c:1385:class_connect()) connect: client 1eafa3d0-ec8d-483b-8029-cb6f866d8e8e, cookie 0x76b2fec9b050939a 00000100:00080000:2.0:1789130684.841667:0:23508:0:(import.c:65:import_set_state_nolock()) ffff9e9c8479e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130684.841778:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+5:3641:x1876038857776512:12345-0@lo:250:mount.lustre.0 Request processed in 12896us (13021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130684.841789:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130684.841844:0:3641:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789130684.841854:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.110@tcp: connect to target with instance 0 00000100:00080000:2.0:1789130684.841871:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789130684.841877:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789130684.841880:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cb3534800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789130684.841883:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789130684.841894:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789130684.841900:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3641:1876038857776512:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789130684.856727:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130684.856992:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789130684.856999:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789130684.859472:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789130684.859486:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789130684.860062:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789130684.860069:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789130684.862146:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130684.862398:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789130684.862404:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789130684.863117:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789130684.863125:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789130684.913910:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789130684.914364:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789130684.914372:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789130684.920121:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789130684.920136:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789130684.921134:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130684.921516:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789130684.921523:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789130684.928126:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789130684.928147:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789130684.932918:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130684.933122:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789130684.933130:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789130684.933735:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789130684.933740:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789130684.934200:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130684.934433:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789130684.934439:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789130684.934895:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789130684.934901:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789130684.979116:0:23494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130684.979367:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789130684.979375:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789130684.981312:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789130684.981327:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789130684.982440:0:23494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789130684.982451:0:23494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789130684.984131:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789130684.984162:0:23494:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789130684.984169:0:23494:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789130684.984296:0:23494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789130684.984343:0:23494:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.110@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789130684.984347:0:23494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789130684.984349:0:23494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130684.984350:0:23494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130684.984352:0:23494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130684.984353:0:23494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130684.984354:0:23494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130684.984356:0:23494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130684.984357:0:23494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130684.984359:0:23494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130684.984361:0:23494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130684.984363:0:23494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789130684.984366:0:23494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130684.984367:0:23494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130684.984368:0:23494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130684.984369:0:23494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130684.984370:0:23494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130684.984371:0:23494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130684.984372:0:23494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130684.984373:0:23494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130684.984374:0:23494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130684.984375:0:23494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130684.984416:0:23494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789130684.984439:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3492940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857776640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789130684.984522:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130684.984575:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c9fab1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130684.984740:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857776640 00000100:00100000:2.0:1789130684.984755:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857776640 00000100:00100000:2.0:1789130684.984805:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130684.984816:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+5:23494:x1876038857776640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789130684.984883:0:23510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789130684.984887:0:23510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789130684.984890:0:23510:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789130684.985656:0:23531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789130684.986240:0:23510:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1789130684.995542:0:23532:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789130684.995551:0:23532:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789130684.995554:0:23532:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789130684.995577:0:23532:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789130684.996443:0:23532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789130684.996731:0:23510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789130684.996743:0:23510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789130684.999669:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+5:23494:x1876038857776640:12345-0@lo:253:mount.lustre.0 Request processed in 14845us (15136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130684.999686:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130685.000068:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3492940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857776640:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789130685.000085:0:23494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789130685.000088:0:23494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130685.000090:0:23494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130685.000103:0:23494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130685.000104:0:23494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130685.000105:0:23494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130685.000106:0:23494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130685.000108:0:23494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130685.000109:0:23494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130685.000111:0:23494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130685.000112:0:23494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789130685.000130:0:23494:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9cb353d000 from lustre-MDT0000 10000000:01000000:3.0:1789130685.000165:0:23494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789130685.000168:0:23494:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789130685.000173:0:23494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e9b841b1a48 10000000:01000000:3.0:1789130685.000178:0:23494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130685.000187:0:23494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e9b841b1a48 from 1 10000000:01000000:3.0:1789130685.000190:0:23494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789130685.000234:0:23494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.000245:0:23494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.000255:0:23494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130685.000277:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3492940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857776768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130685.000451:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130685.000536:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c9fab1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.000587:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857776768 00000100:00100000:2.0:1789130685.000592:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857776768 00000100:00100000:2.0:1789130685.000850:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130685.000875:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+5:23494:x1876038857776768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130685.000890:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130685.000908:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a92400/0x76b2fec9b05093a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05093a1 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.000932:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a92400/0x76b2fec9b05093a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05093a1 expref: 6 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.000943:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a92400/0x76b2fec9b05093a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05093a1 expref: 6 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.000963:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a92400, rc 0) 00000100:00100000:2.0:1789130685.001017:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+6:23494:x1876038857776768:12345-0@lo:101:mount.lustre.0 Request processed in 145us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.001024:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130685.001206:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3492940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857776768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130685.001221:0:23494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.001230:0:23494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130685.001291:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857776896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130685.001330:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.001357:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada446c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.001517:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857776896 00000100:00100000:2.0:1789130685.001521:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857776896 00000100:00100000:2.0:1789130685.001549:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130685.001555:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+6:23494:x1876038857776896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130685.001655:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+6:23494:x1876038857776896:12345-0@lo:501:mount.lustre.0 Request processed in 99us (335us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130685.001663:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130685.001751:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857776896:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789130685.001777:0:23494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789130685.001786:0:23494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.001794:0:23494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130685.001803:0:23494:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9cb353d000 10000000:01000000:0.0:1789130685.001807:0:23494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789130685.001811:0:23494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e9cb353d000 10000000:01000000:0.0:1789130685.001813:0:23494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789130685.001816:0:23494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e9cb353d000 from 1 10000000:01000000:0.0:1789130685.001818:0:23494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789130685.001836:0:23494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ac00/0x76b2fec9b05093af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.001874:0:23494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ac00/0x76b2fec9b05093af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.001882:0:23494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ac00/0x76b2fec9b05093af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130685.001895:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857777024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130685.001920:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.001936:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada446c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130685.002080:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857777024 00000100:00100000:3.0:1789130685.002085:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857777024 00000100:00100000:3.0:1789130685.002107:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789130685.002114:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+6:23494:x1876038857777024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130685.002121:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130685.002138:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb94e00/0x76b2fec9b05093b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05093af expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.002153:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb94e00/0x76b2fec9b05093b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05093af expref: 7 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.002163:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb94e00/0x76b2fec9b05093b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05093af expref: 7 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.002170:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb94e00, rc 0) 00000100:00100000:3.0:1789130685.002206:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+7:23494:x1876038857777024:12345-0@lo:101:mount.lustre.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130685.002213:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789130685.002643:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857777024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130685.002656:0:23494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ac00/0x76b2fec9b05093af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093b6 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.002665:0:23494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ac00/0x76b2fec9b05093af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05093b6 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130685.002678:0:23494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789130685.002681:0:23494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ac00/0x76b2fec9b05093af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093b6 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.002688:0:23494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ac00/0x76b2fec9b05093af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093b6 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130685.002695:0:23494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789130685.002698:0:23494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789130685.002703:0:23494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e9cb353d000 10000000:01000000:0.0:1789130685.002706:0:23494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789130685.002716:0:23494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789130685.002718:0:23494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789130685.002735:0:23494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a600/0x76b2fec9b05093bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.002742:0:23494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a600/0x76b2fec9b05093bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.002750:0:23494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a600/0x76b2fec9b05093bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130685.002763:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857777152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130685.002790:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.002809:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada446c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.002889:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857777152 00000100:00100000:2.0:1789130685.002895:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857777152 00000100:00100000:2.0:1789130685.002916:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130685.002922:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+7:23494:x1876038857777152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130685.002933:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130685.002943:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a92a00/0x76b2fec9b05093c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05093bd expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.002971:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a92a00/0x76b2fec9b05093c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05093bd expref: 8 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.002981:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a92a00/0x76b2fec9b05093c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05093bd expref: 8 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.002988:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a92a00, rc 0) 00000100:00100000:2.0:1789130685.003029:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+8:23494:x1876038857777152:12345-0@lo:101:mount.lustre.0 Request processed in 107us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.003036:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130685.003169:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857777152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130685.003180:0:23494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a600/0x76b2fec9b05093bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093c4 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.003188:0:23494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a600/0x76b2fec9b05093bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05093c4 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130685.003233:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857777280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130685.003257:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.003278:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada446c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.003842:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857777280 00000100:00100000:2.0:1789130685.003848:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857777280 00000100:00100000:2.0:1789130685.003903:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130685.003913:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+8:23494:x1876038857777280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130685.005159:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+9:23494:x1876038857777280:12345-0@lo:501:mount.lustre.0 Request processed in 1242us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.005173:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130685.006147:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857777280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130685.006747:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857777408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130685.006817:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.006986:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada446c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.007127:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857777408 00000100:00100000:2.0:1789130685.007133:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857777408 00000100:00100000:2.0:1789130685.007220:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130685.007229:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+9:23494:x1876038857777408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130685.008843:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+9:23494:x1876038857777408:12345-0@lo:503:mount.lustre.0 Request processed in 1608us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.008873:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789130685.009222:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857777408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130685.010131:0:23533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23533:1876038857777536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130685.010196:0:23533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130685.010260:0:23533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91e27480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130685.010300:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857777536 00000100:00100000:3.0:1789130685.010306:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857777536 00000100:00100000:3.0:1789130685.010576:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130685.010587:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+9:23533:x1876038857777536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130685.011345:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+9:23533:x1876038857777536:12345-0@lo:502:llog_process_th.0 Request processed in 757us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130685.011356:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130685.011499:0:23533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23533:1876038857777536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130685.011530:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130685.011541:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130685.011544:0:23533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789130685.011549:0:23533:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789130685.011551:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789130685.011564:0:23533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e9b841b4ed8) 00000020:00000080:1.0:1789130685.011581:0:23533:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789130685.011586:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789130685.011702:0:23533:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789130685.011711:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76b2fec9b05093d2 00000020:00000080:1.0:1789130685.012235:0:23533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789130685.012240:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130685.012245:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130685.012246:0:23533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789130685.012249:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130685.012253:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130685.012255:0:23533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789130685.012258:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789130685.012267:0:23533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e9b82bb9a48) 00000020:00000080:1.0:1789130685.012278:0:23533:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789130685.012282:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789130685.012284:0:23533:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789130685.012287:0:23533:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789130685.012293:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789130685.012339:0:23533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9cb353d000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789130685.012353:0:23533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e9b82bbb490) 00000020:00000080:1.0:1789130685.012370:0:23533:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789130685.012437:0:23533:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789130685.012444:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76b2fec9b05093e7 00000020:00000080:1.0:1789130685.012534:0:23533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789130685.012540:0:23533:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789130685.012544:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x76b2fec9b05093ee 00080000:01000000:1.0:1789130685.012548:0:23533:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789130685.012551:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76b2fec9b05093f5 00010000:00010000:2.0:1789130685.116641:0:23533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789130685.118517:0:23533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:2.0:1789130685.119031:0:23533:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789130685.119497:0:23533:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e9b830b0000) 00000020:00000080:2.0:1789130685.119518:0:23533:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789130685.119588:0:23533:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789130685.119595:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76b2fec9b0509403 00000020:00000080:3.0:1789130685.134153:0:23533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789130685.137500:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x76b2fec9b050940a 00000020:00000080:3.0:1789130685.138417:0:23533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789130685.138432:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130685.138439:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130685.138441:0:23533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789130685.138445:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789130685.138448:0:23533:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1789130685.138456:0:23533:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789130685.138459:0:23533:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789130685.138460:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789130685.138463:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130685.138465:0:23533:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789130685.138468:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130685.138473:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130685.138474:0:23533:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789130685.138479:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789130685.138520:0:23533:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789130685.138536:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130685.138539:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130685.138540:0:23533:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789130685.138543:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130685.138546:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130685.138548:0:23533:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789130685.138550:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789130685.138556:0:23533:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:00000080:3.0:1789130685.138582:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130685.138597:0:23533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9e9cb3d49a48) 00000020:00000080:3.0:1789130685.138714:0:23533:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789130685.138722:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789130685.138784:0:23533:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789130685.138853:0:23533:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789130685.138870:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76b2fec9b0509418 00010000:00080000:3.0:1789130685.138904:0:23533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9c90991800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.110@tcp at head 00010000:00010000:3.0:1789130685.141553:0:23533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789130685.143168:0:23533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789130685.143184:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789130685.143231:0:23533:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789130685.143253:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76b2fec9b050941f 00000100:00080000:2.0:1789130685.143265:0:23533:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130685.143270:0:23533:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e9c90991800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130685.143309:0:23533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2f0c0 x1876038857777664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130685.143340:0:23533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789130685.143392:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130685.143401:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.143403:0:23533:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789130685.143407:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789130685.143410:0:23533:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789130685.143411:0:23533:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789130685.143413:0:23533:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789130685.143414:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789130685.143417:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.143418:0:23533:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789130685.143421:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789130685.143425:0:23533:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789130685.143429:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.143430:0:23533:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789130685.143433:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789130685.143436:0:23533:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:01000000:2.0:1789130685.143462:0:23533:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789130685.143465:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789130685.143477:0:23533:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e9b830b1a48) 00000020:00000080:2.0:1789130685.143489:0:23533:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789130685.143494:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789130685.143561:0:23533:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789130685.143567:0:23533:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789130685.143574:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76b2fec9b050942d 00010000:00080000:2.0:1789130685.143604:0:23533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9c9fa50000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.110@tcp at head 00010000:00010000:2.0:1789130685.143817:0:23533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1789130685.144476:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857777664:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789130685.144548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130685.145137:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857777664 00000100:00100000:2.0:1789130685.145148:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857777664 00000100:00100000:2.0:1789130685.145191:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130685.145199:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3491e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876038857777664:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789130685.145231:0:23520:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1789130685.150661:0:23533:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789130685.151399:0:23533:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789130685.163601:0:23533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130685.164475:0:23533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789130685.172315:0:23533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789130685.172965:0:23539:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789130685.172972:0:23539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789130685.175302:0:23533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789130685.175333:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789130685.175377:0:23533:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789130685.175398:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76b2fec9b0509434 00000100:00080000:2.0:1789130685.175411:0:23533:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130685.175418:0:23533:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e9c9fa50000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130685.175455:0:23533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2de00 x1876038857777792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130685.175487:0:23533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789130685.175545:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130685.175549:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.175551:0:23533:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789130685.175554:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789130685.175557:0:23533:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1789130685.175559:0:23533:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789130685.175560:0:23533:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789130685.175562:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789130685.175564:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.175565:0:23533:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789130685.175568:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789130685.175572:0:23533:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789130685.175575:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.175577:0:23533:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789130685.175579:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789130685.175583:0:23533:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:01000000:2.0:1789130685.175608:0:23533:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789130685.175638:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789130685.175651:0:23533:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e9b830b3490) 00000020:00000080:2.0:1789130685.175662:0:23533:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789130685.175667:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789130685.175727:0:23533:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789130685.175734:0:23533:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789130685.175746:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76b2fec9b0509442 00010000:00080000:2.0:1789130685.175786:0:23533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9c9fa54800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.110@tcp at head 00000100:00100000:3.0:1789130685.175992:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857777792:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789130685.176051:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857777792 offset 0 length 520: 4 00000100:00100000:1.0:1789130685.177337:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3491e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876038857777664:12345-0@lo:38:llog_process_th.0 Request processed in 32132us (32782us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789130685.177369:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789130685.177511:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789130685.177517:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789130685.177521:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857777664:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1789130685.185259:0:23533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789130685.185346:0:23533:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789130685.185363:0:23533:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789130685.189566:0:23533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130685.191081:0:23533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789130685.191324:0:23533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1789130685.198297:0:23541:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789130685.198305:0:23541:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789130685.199978:0:23533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789130685.199993:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789130685.200033:0:23533:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789130685.200054:0:23533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76b2fec9b0509449 00000100:00080000:0.0:1789130685.200064:0:23533:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130685.200070:0:23533:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9c9fa54800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130685.200108:0:23533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359e1c0 x1876038857777920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130685.200138:0:23533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789130685.200245:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857777920:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789130685.200310:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857777920 offset 0 length 520: 4 00000020:01000000:0.0:1789130685.200509:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130685.200514:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130685.200516:0:23533:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789130685.200519:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130685.200523:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130685.200525:0:23533:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789130685.200528:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789130685.200530:0:23533:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789130685.200532:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130685.200535:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130685.200536:0:23533:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789130685.200538:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130685.200540:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130685.200542:0:23533:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789130685.200545:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789130685.200579:0:23533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23533:1876038857778048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130685.200687:0:23533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.200714:0:23533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada44f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.200907:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857778048 00000100:00100000:2.0:1789130685.200916:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857778048 00000100:00100000:2.0:1789130685.200973:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789130685.200982:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+9:23533:x1876038857778048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130685.201123:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+9:23533:x1876038857778048:12345-0@lo:502:llog_process_th.0 Request processed in 141us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.201131:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130685.201334:0:23533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23533:1876038857778048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130685.201362:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130685.201367:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130685.201370:0:23533:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789130685.201373:0:23533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789130685.201594:0:23494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789130685.201652:0:23494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789130685.201671:0:23494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a600/0x76b2fec9b05093bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093c4 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.201681:0:23494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a600/0x76b2fec9b05093bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093c4 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130685.201689:0:23494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9cb353d000 from 1 10000000:01000000:2.0:1789130685.201692:0:23494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789130685.201720:0:23494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.201728:0:23494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.201737:0:23494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130685.201766:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789130685.201799:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130685.201821:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130685.201957:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857778176 00000100:00100000:0.0:1789130685.201963:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857778176 00000100:00100000:0.0:1789130685.202005:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130685.202012:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+9:23494:x1876038857778176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130685.202022:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130685.202036:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b0509450 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.202056:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 10 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.202066:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 10 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.202075:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9cb4e6ba00, rc 0) 00000100:00100000:0.0:1789130685.202105:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+10:23494:x1876038857778176:12345-0@lo:101:mount.lustre.0 Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130685.202111:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789130685.202334:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130685.202347:0:23494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.202356:0:23494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789130685.206130:0:12461:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789130685.206141:0:12461:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789130685.206146:0:12461:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789130685.206155:0:12461:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 703 00000100:00080000:1.0:1789130685.206162:0:12461:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789130685.206169:0:12461:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e9c90991800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1789130685.206222:0:12461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b83ae9680 x1876038857778432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130685.206251:0:12461:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130685.206255:0:12461:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789130685.206344:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857778432:0@lo:38:kworker.0 00000100:00100000:3.0:1789130685.206420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130685.206609:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857778432 00000100:00100000:1.0:1789130685.206645:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857778432 00000100:00100000:1.0:1789130685.206682:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130685.206691:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3493840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857778432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789130685.206708:0:23521:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789130685.206826:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3493840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857778432:12345-0@lo:38:kworker.0 Request processed in 135us (406us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789130685.206835:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789130685.207022:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130685.207028:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130685.207031:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857778432:0@lo:38:kworker.0 00000100:00100000:0.0:1789130685.207651:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778304:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789130685.207706:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.207743:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada44f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.207832:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857778304 00000100:00100000:2.0:1789130685.207837:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857778304 00000100:00100000:2.0:1789130685.207887:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789130685.207895:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+10:23494:x1876038857778304:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789130685.207914:0:23508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789130685.207919:0:23508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789130685.208007:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+10:23494:x1876038857778304:12345-0@lo:256:mount.lustre.0 Request processed in 113us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.208015:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130685.208093:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778304:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789130685.208667:0:23494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789130685.208686:0:23494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130685.208696:0:23494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130685.208704:0:23494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9cb353d000 from 1 10000000:01000000:1.0:1789130685.208707:0:23494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130685.208740:0:23494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130685.208748:0:23494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130685.208757:0:23494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130685.208772:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789130685.208805:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130685.208834:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91e27780 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.209117:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857778560 00000100:00100000:2.0:1789130685.209122:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857778560 00000100:00100000:2.0:1789130685.209163:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130685.209172:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+10:23494:x1876038857778560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130685.209195:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130685.209294:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050945e expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.209317:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050945e expref: 11 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.209328:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050945e expref: 11 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.209337:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a93800, rc 0) 00000100:00100000:2.0:1789130685.209385:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23494:x1876038857778560:12345-0@lo:101:mount.lustre.0 Request processed in 214us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.209390:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130685.209473:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130685.209489:0:23494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130685.209509:0:23494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130685.209572:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130685.209599:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130685.209647:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91e27780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130685.209715:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857778688 00000100:00100000:3.0:1789130685.209721:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857778688 00000100:00100000:3.0:1789130685.209753:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130685.209761:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23494:x1876038857778688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130685.209905:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23494:x1876038857778688:12345-0@lo:501:mount.lustre.0 Request processed in 144us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130685.209918:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789130685.209992:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130685.210020:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130685.210059:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130685.210084:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91e27780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130685.210191:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857778816 00000100:00100000:3.0:1789130685.210196:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857778816 00000100:00100000:3.0:1789130685.210246:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130685.210252:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23494:x1876038857778816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130685.210333:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23494:x1876038857778816:12345-0@lo:503:mount.lustre.0 Request processed in 80us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130685.210340:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789130685.210572:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857778816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130685.211775:0:23543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23543:1876038857778944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130685.211838:0:23543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130685.211880:0:23543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883ad240 going to sleep for 11 seconds 00000100:00100000:3.0:1789130685.211994:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857778944 00000100:00100000:3.0:1789130685.212000:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857778944 00000100:00100000:3.0:1789130685.212036:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130685.212045:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23543:x1876038857778944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130685.212846:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23543:x1876038857778944:12345-0@lo:502:llog_process_th.0 Request processed in 799us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130685.212867:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789130685.213772:0:23543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23543:1876038857778944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130685.213840:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130685.213850:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.213852:0:23543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789130685.213870:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9cb353d000 00000020:00000080:2.0:1789130685.213873:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130685.213882:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130685.213885:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.213886:0:23543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789130685.213889:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130685.213891:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.213893:0:23543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789130685.213906:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9cb353d000 00000020:00000080:2.0:1789130685.213908:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130685.213988:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130685.213992:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.213993:0:23543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789130685.213996:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130685.213998:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.214000:0:23543:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130685.214003:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9cb353d000 00000020:00000080:2.0:1789130685.214006:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130685.214023:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130685.214026:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.214027:0:23543:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130685.214029:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130685.214031:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.214032:0:23543:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130685.214035:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9cb353d000 00000020:00000080:2.0:1789130685.214037:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130685.214050:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130685.214052:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.214053:0:23543:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130685.214056:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130685.214059:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.214060:0:23543:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789130685.214063:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9cb353d000 00000020:00000080:2.0:1789130685.214066:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130685.214080:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130685.214082:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.214083:0:23543:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789130685.214086:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130685.214089:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.214090:0:23543:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789130685.214093:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9cb353d000 00000020:00000080:2.0:1789130685.214100:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130685.214153:0:23543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23543:1876038857779072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130685.214224:0:23543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130685.214260:0:23543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130685.217818:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857779072 00000100:00100000:3.0:1789130685.217834:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857779072 00000100:00100000:3.0:1789130685.217908:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130685.217922:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23543:x1876038857779072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130685.218109:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23543:x1876038857779072:12345-0@lo:502:llog_process_th.0 Request processed in 190us (3884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130685.218118:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789130685.218461:0:23543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23543:1876038857779072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130685.218501:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130685.218508:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130685.218511:0:23543:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789130685.218515:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789130685.218726:0:23494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789130685.218748:0:23494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130685.218769:0:23494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.218793:0:23494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130685.218844:0:23494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789130685.218847:0:23494:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9cb353d000 10000000:01000000:3.0:1789130685.218849:0:23494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9cb353d000 10000000:01000000:3.0:1789130685.218853:0:23494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130685.218868:0:23494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9cb353d000 from 1 10000000:01000000:3.0:1789130685.218871:0:23494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130685.218899:0:23494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95e00/0x76b2fec9b050946c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.218906:0:23494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95e00/0x76b2fec9b050946c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.218915:0:23494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95e00/0x76b2fec9b050946c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130685.218933:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857779200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130685.218979:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130685.219008:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.220225:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857779200 00000100:00100000:2.0:1789130685.220235:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857779200 00000100:00100000:2.0:1789130685.220286:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789130685.220294:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23494:x1876038857779200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130685.220309:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130685.220323:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a92e00/0x76b2fec9b0509473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050946c expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.220347:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a92e00/0x76b2fec9b0509473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050946c expref: 12 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.220358:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a92e00/0x76b2fec9b0509473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050946c expref: 12 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.220367:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a92e00, rc 0) 00000100:00100000:2.0:1789130685.220427:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23494:x1876038857779200:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.220434:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130685.220588:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857779200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130685.220604:0:23494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95e00/0x76b2fec9b050946c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509473 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.220636:0:23494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95e00/0x76b2fec9b050946c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509473 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130685.220719:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857779328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130685.220746:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130685.220771:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.221193:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857779328 00000100:00100000:2.0:1789130685.221260:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857779328 00000100:00100000:2.0:1789130685.221293:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789130685.221299:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23494:x1876038857779328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130685.221407:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23494:x1876038857779328:12345-0@lo:501:mount.lustre.0 Request processed in 108us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.221415:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130685.221480:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857779328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130685.221511:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857779456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130685.221548:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130685.221567:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130685.221603:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857779456 00000100:00100000:2.0:1789130685.221607:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857779456 00000100:00100000:2.0:1789130685.221650:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789130685.221656:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23494:x1876038857779456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130685.221727:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23494:x1876038857779456:12345-0@lo:503:mount.lustre.0 Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130685.221733:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789130685.221827:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857779456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130685.236921:0:23545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23545:1876038857779584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130685.237099:0:23545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130685.237155:0:23545:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada80f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130685.237294:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857779584 00000100:00100000:0.0:1789130685.237303:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857779584 00000100:00100000:0.0:1789130685.237357:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789130685.237366:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23545:x1876038857779584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130685.237506:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23545:x1876038857779584:12345-0@lo:502:llog_process_th.0 Request processed in 141us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130685.237515:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789130685.237572:0:23545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23545:1876038857779584:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789130685.237715:0:23545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789130685.237729:0:23545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e9cad8b9a48) 00000020:00000080:0.0:1789130685.237748:0:23545:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1789130685.237823:0:23545:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9cb353d000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789130685.237828:0:23545:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9cb353d000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789130685.237830:0:23545:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9cb353d000 4 00010000:00080000:0.0:1789130685.237868:0:23545:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9c8760f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.110@tcp at head 00010000:00010000:0.0:1789130685.245460:0:23545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1789130685.245702:0:23545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789130685.245749:0:23545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789130685.245765:0:23545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x76b2fec9b0509481 00000100:00080000:0.0:1789130685.245776:0:23545:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130685.245782:0:23545:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e9c8760f800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130685.245820:0:23545:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359da40 x1876038857779712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130685.247055:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876038857779712:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789130685.247133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.247242:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857779712 00000100:00100000:0.0:1789130685.247251:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857779712 00000100:00100000:0.0:1789130685.247291:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130685.247299:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876038857779712:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789130685.247367:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876038857779712:12345-0@lo:38:llog_process_th.0 Request processed in 68us (234us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789130685.247376:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130685.247428:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130685.247436:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c8760f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130685.247451:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789130685.247465:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876038857779712:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789130685.247484:0:23545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789130685.248888:0:12461:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130685.248897:0:12461:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789130685.251473:0:23545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23545:1876038857779840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130685.251560:0:23545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.251634:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857779840 00000100:00100000:0.0:1789130685.251640:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857779840 00000100:00100000:0.0:1789130685.251682:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130685.251690:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23545:x1876038857779840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130685.251805:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23545:x1876038857779840:12345-0@lo:502:llog_process_th.0 Request processed in 116us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130685.251813:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130685.251877:0:23545:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cad6f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130685.251900:0:23545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23545:1876038857779840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130685.251944:0:23545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23545:1876038857779968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130685.253379:0:23545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.253423:0:23545:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cad6f7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130685.255432:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857779968 00000100:00100000:3.0:1789130685.255445:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857779968 00000100:00100000:3.0:1789130685.255509:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789130685.255518:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23545:x1876038857779968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130685.255690:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23545:x1876038857779968:12345-0@lo:502:llog_process_th.0 Request processed in 172us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130685.255698:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130685.256293:0:23545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23545:1876038857779968:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789130685.256338:0:23545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789130685.256408:0:23494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789130685.256433:0:23494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789130685.256458:0:23494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95e00/0x76b2fec9b050946c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509473 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.256483:0:23494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95e00/0x76b2fec9b050946c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509473 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789130685.256534:0:23494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789130685.256536:0:23494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789130685.256538:0:23494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130685.256539:0:23494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130685.256541:0:23494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130685.256542:0:23494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130685.256544:0:23494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130685.256546:0:23494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789130685.256548:0:23494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130685.256549:0:23494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789130685.256554:0:23494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789130685.256557:0:23494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789130685.256558:0:23494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789130685.256559:0:23494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130685.256560:0:23494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130685.256562:0:23494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130685.256563:0:23494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130685.256564:0:23494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130685.256565:0:23494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789130685.256566:0:23494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130685.256567:0:23494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789130685.256592:0:23494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789130685.256632:0:23494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857780096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789130685.256691:0:23494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130685.256723:0:23494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c86eb1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130685.256742:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857780096 00000100:00100000:0.0:1789130685.256747:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857780096 00000100:00100000:0.0:1789130685.256783:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130685.256791:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23494:x1876038857780096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789130685.256818:0:23508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789130685.256843:0:23508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789130685.268278:0:23508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789130685.268297:0:23508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789130685.269324:0:23531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789130685.269332:0:23531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789130685.269358:0:23531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.269377:0:23531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 12 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.269394:0:23531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.269439:0:23531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 12 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.269456:0:23531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 12 pid: 23509 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130685.269473:0:23531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34930c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857780224:0@lo:104: 00000100:00100000:3.0:1789130685.269547:0:23531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130685.269588:0:23531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cada80540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130685.270134:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857780224 00000100:00100000:1.0:1789130685.270143:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857780224 00000100:00100000:1.0:1789130685.270186:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130685.270195:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:23531:x1876038857780224:12345-0@lo:104: 00010000:00010000:1.0:1789130685.270218:0:23498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130685.270280:0:23498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789130685.270286:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:23531:x1876038857780224:12345-0@lo:104: Request processed in 93us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130685.270294:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130685.270334:0:23531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34930c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857780224:0@lo:104: 00010000:00010000:1.0:1789130685.270353:0:23531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.270587:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130685.270594:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.270602:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a93400 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:0.0:1789130685.270606:0:23504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.270633:0:23504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130685.270641:0:23504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130685.270647:0:23504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130685.270687:0:23504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.270693:0:23504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130685.270711:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.270718:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93400/0x76b2fec9b0509450 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509457 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.270734:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130685.270735:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130685.270737:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130685.270763:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130685.270780:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857780352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130685.270816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130685.271648:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23494:x1876038857780096:12345-0@lo:253:mount.lustre.0 Request processed in 14854us (14953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130685.271662:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789130685.271819:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857780352 00000100:00100000:3.0:1789130685.271826:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857780352 00010000:00010000:3.0:1789130685.271850:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 12 pid: 23509 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130685.271893:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130685.271901:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:3644:x1876038857780352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130685.271913:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130685.271918:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 12 pid: 23509 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.271930:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 12 pid: 23509 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.271945:0:23500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb4e6ba00/0x76b2fec9b0509457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b0509450 expref: 12 pid: 23509 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.273125:0:23500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.273134:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789130685.273150:0:23500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003819177s 00010000:00010000:3.0:1789130685.273156:0:23500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.273164:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.273171:0:23500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.273179:0:23500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.273185:0:23500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c9fb94a00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:3.0:1789130685.273188:0:23500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.273195:0:23500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130685.273363:0:23494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23494:1876038857780096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789130685.273379:0:23494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789130685.273383:0:23494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789130685.273385:0:23494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789130685.273386:0:23494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130685.273388:0:23494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130685.273389:0:23494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130685.273390:0:23494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130685.273392:0:23494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130685.273393:0:23494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789130685.273395:0:23494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130685.273396:0:23494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789130685.273413:0:23494:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789130685.277968:0:23500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.278008:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130685.278127:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:3644:x1876038857780352:12345-0@lo:103:ldlm_bl.0 Request processed in 6222us (7305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130685.278139:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789130685.283122:0:23531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130685.283145:0:23531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130685.283154:0:23531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c9fb94a00/0x76b2fec9b0509488 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130685.283711:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857780352:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789130685.326056:0:23494:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1789130685.329569:0:23494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789130685.331125:0:23557:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1789130685.331136:0:23557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1789130685.333375:0:23558:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789130685.333882:0:23494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:0.0:1789130685.334598:0:23494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789130685.335071:0:23494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130685.335771:0:23558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789130685.336758:0:23494:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789130685.336771:0:23494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789130685.336844:0:23494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130685.344192:0:23494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00080000:2.0:1789130685.345160:0:23559:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9e9cb4e2fc00 x1876038857780480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130685.345175:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00000040:00080000:1.0:1789130685.345414:0:23558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789130685.345485:0:23558:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789130685.345886:0:23494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789130685.345929:0:23494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789130685.354878:0:23494:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1789130685.357163:0:23494:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1789130685.366806:0:23494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789130685.368881:0:23494:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789130685.368921:0:23494:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffade7417e3988 00100000:10000000:0.0:1789130685.368930:0:23494:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789130685.370067:0:23494:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789130685.370085:0:23494:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789130685.370108:0:23494:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789130685.370134:0:23494:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789130685.381679:0:23494:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130685.381919:0:23494:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789130685.848879:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789130685.912747:0:23512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789130685.912756:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9cb353d000 from 11 10000000:01000000:2.0:1789130685.912761:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789130685.912812:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.912822:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.912833:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130685.912887:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857780608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130685.912966:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130685.913014:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c81254240 going to sleep for 11 seconds 00000100:00100000:0.0:1789130685.913295:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857780608 00000100:00100000:0.0:1789130685.913303:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857780608 00000100:00100000:0.0:1789130685.913366:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789130685.913376:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+11:23512:x1876038857780608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130685.913394:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130685.913409:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050948f expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.913434:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050948f expref: 12 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.913445:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050948f expref: 12 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130685.913454:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9cb4e6bc00, rc 0) 00000100:00100000:0.0:1789130685.913512:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23512:x1876038857780608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130685.913519:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130685.913817:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857780608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130685.913833:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130685.913842:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130685.913908:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857780736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789130685.913943:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130685.913972:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c81254240 going to sleep for 11 seconds 00000100:00100000:1.0:1789130685.915245:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857780736 00000100:00100000:1.0:1789130685.915256:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857780736 00000100:00100000:1.0:1789130685.915318:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130685.915327:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23512:x1876038857780736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789130685.915350:0:23508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789130685.915374:0:23508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789130685.915377:0:23508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789130685.915530:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:23512:x1876038857780736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130685.915542:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789130685.916694:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857780736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789130685.916750:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789130685.916759:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130685.916768:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130686.300761:0:23551:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789130686.300772:0:23551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130686.301758:0:23551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789130686.301767:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789130686.366282:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:0.0:1789130686.873404:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130687.327918:0:23551:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789130687.327930:0:23551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130687.328120:0:23551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1789130687.328176:0:23551:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789130687.328372:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1789130687.398261:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:3.0:1789130687.898899:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130688.422694:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:1.0:1789130688.921299:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130689.442091:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:3.0:1789130689.945721:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789130690.267226:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789130690.267234:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789130690.267238:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789130690.267246:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 704 00000100:00080000:1.0:1789130690.267252:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789130690.267258:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e9c90991800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1789130690.267283:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b83ae8000 x1876038857780992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130690.267299:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130690.267302:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130690.267305:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130690.267308:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130690.267311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789130690.267314:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789130690.267316:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c8760f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789130690.267320:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e9c8760f800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1789130690.267333:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b83aea1c0 x1876038857781120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130690.267378:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130690.267390:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857780864:0@lo:400:kworker.0 00000100:00100000:1.0:1789130690.267475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130690.267774:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857780992:0@lo:38:kworker.0 00000100:00100000:2.0:1789130690.267807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130690.267842:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876038857781120:0@lo:38:kworker.0 00000100:00100000:2.0:1789130690.267867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130690.267939:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857781120 00000100:00100000:2.0:1789130690.267947:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857781120 00000100:00100000:2.0:1789130690.267984:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130690.267991:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876038857781120:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789130690.268086:0:23517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:2.0:1789130690.268128:0:23517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x76b2fec9b050949d 00000004:00100000:2.0:1789130690.268147:0:23517:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789130690.268309:0:23517:0:(import.c:65:import_set_state_nolock()) ffff9e9c942f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130690.268364:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876038857781120:12345-0@lo:38:kworker.0 Request processed in 372us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130690.268371:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789130690.268411:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9b83aea1c0 x1876038857781120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789130690.268425:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789130690.268432:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789130690.268436:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789130690.268439:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c8760f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789130690.268445:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876038857781120:0@lo:38:kworker.0 00000100:00100000:1.0:1789130690.268790:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857780992 00000100:00100000:1.0:1789130690.268795:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857780992 00000100:00100000:1.0:1789130690.268832:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130690.268837:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857780992:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789130690.268849:0:23521:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789130690.268893:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857780992:12345-0@lo:38:kworker.0 Request processed in 55us (1085us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789130690.268906:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130690.269071:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857780864 00000100:00100000:3.0:1789130690.269076:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857780864 00000100:00100000:3.0:1789130690.269106:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789130690.269112:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:3643:x1876038857780864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130690.269152:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:3643:x1876038857780864:12345-0@lo:400:kworker.0 Request processed in 41us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130690.269159:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789130690.269301:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857780864:0@lo:400:kworker.0 00000100:00080000:2.0:1789130690.269378:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130690.269383:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130690.269386:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857780992:0@lo:38:kworker.0 00000100:00100000:2.0:1789130690.456746:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:0.0:1789130690.973705:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130691.391119:0:23802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789130691.484160:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:2.0:1789130692.001195:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789130692.462989:0:23855:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789130692.463185:0:23855:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789130692.505075:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:0.0:1789130693.020857:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130693.538762:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00000020:00000004:3.0:1789130693.640533:0:23905:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789130693.641057:0:23905:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789130694.040872:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130694.553719:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:0.0:1789130695.065357:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130695.384731:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130685/real 1789130685] req@ffff9e9cb359e1c0 x1876038857777920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130695 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789130695.384770:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1789130695.384772:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb359e1c0 x1876038857777920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130695 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789130695.384774:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789130695.384778:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1789130695.384782:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130685/real 1789130685] req@ffff9e9cb4e2de00 x1876038857777792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130695 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789130695.384783:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 709 00000100:00080000:1.0:1789130695.384788:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789130695.384795:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e9c90991800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130695.384802:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb4e2de00 x1876038857777792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130695 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130695.384814:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b83ae9a40 x1876038857781376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130695.384817:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130695.384824:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130695.384827:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130695.384828:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:1.0:1789130695.384830:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789130695.384831:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857777920:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789130695.384833:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789130695.384838:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789130695.384949:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857781248:0@lo:400:kworker.0 00000100:00100000:0.0:1789130695.385029:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130695.385208:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857781248 00000100:00100000:0.0:1789130695.385214:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857781248 00000100:00100000:0.0:1789130695.385307:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789130695.385317:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:3643:x1876038857781248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130695.385368:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:3643:x1876038857781248:12345-0@lo:400:kworker.0 Request processed in 52us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130695.385375:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789130695.385425:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857781248:0@lo:400:kworker.0 00000100:00080000:2.0:1789130695.386337:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa50000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130695.386406:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789130695.386412:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857777792:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789130695.386440:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857781376:0@lo:38:kworker.0 00000100:00100000:2.0:1789130695.386484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130695.386546:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857781376 00000100:00100000:2.0:1789130695.386551:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857781376 00000100:00100000:2.0:1789130695.387019:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130695.387026:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857781376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789130695.387044:0:23521:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789130695.387091:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857781376:12345-0@lo:38:kworker.0 Request processed in 65us (606us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789130695.387098:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789130695.387132:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130695.387136:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130695.387139:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857781376:0@lo:38:kworker.0 00000100:00080000:1.0:1789130695.392701:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 704 00000100:00080000:1.0:1789130695.392712:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789130695.392721:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9c9fa54800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130695.399675:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359f0c0 x1876038857781504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130695.399751:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130695.399756:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789130695.399759:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa50000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130695.399773:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 703 00000100:00080000:0.0:1789130695.399779:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1789130695.399787:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857781504:0@lo:8:kworker.0 00000100:00080000:0.0:1789130695.399787:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e9c9fa50000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130695.399799:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359fc00 x1876038857781760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130695.399845:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857781632:0@lo:400:kworker.0 00000400:00000100:2.0:1789130695.399864:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857781504 offset 0 length 520: 4 00000100:00100000:2.0:1789130695.399920:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857781760:0@lo:8:kworker.0 00000400:00000100:2.0:1789130695.399941:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857781760 offset 0 length 520: 4 00000100:00100000:2.0:1789130695.400257:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130695.400359:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857781632 00000100:00100000:0.0:1789130695.400367:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857781632 00000100:00100000:0.0:1789130695.400422:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130695.400432:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857781632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130695.400495:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857781632:12345-0@lo:400:kworker.0 Request processed in 64us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130695.400510:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789130695.400542:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9cb359f840 x1876038857781632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130695.400557:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857781632:0@lo:400:kworker.0 00000100:00100000:2.0:1789130695.576791:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:2.0:1789130696.089042:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130696.603232:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:1.0:1789130697.112902:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130697.561689:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789130697.625081:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:2.0:1789130698.136849:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130698.648693:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:1.0:1789130699.161876:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130699.676732:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:0.0:1789130700.189883:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789130700.507362:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789130700.507370:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789130700.507374:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789130700.507382:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 714 00000100:00080000:2.0:1789130700.507387:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789130700.507394:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e9c90991800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130700.507418:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2c780 x1876038857782016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130700.507436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130700.507440:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130700.507442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130700.507445:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789130700.507475:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130700.507487:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857781888:0@lo:400:kworker.0 00000100:00100000:2.0:1789130700.507565:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130700.507646:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876038857782144:0@lo:400:kworker.0 00000100:00100000:2.0:1789130700.507676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130700.507728:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857781888 00000100:00100000:2.0:1789130700.507749:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857781888 00000100:00100000:2.0:1789130700.507798:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130700.507807:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:3644:x1876038857781888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130700.507878:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:3644:x1876038857781888:12345-0@lo:400:kworker.0 Request processed in 60us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130700.507886:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130700.507920:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857782144 00000100:00100000:2.0:1789130700.507925:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857782144 00000100:00100000:2.0:1789130700.507951:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130700.507956:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876038857782144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130700.508002:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876038857782144:12345-0@lo:400:kworker.0 Request processed in 46us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130700.508028:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130700.508055:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857782016:0@lo:38:kworker.0 00000100:00100000:2.0:1789130700.508098:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130700.508141:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857782016 00000100:00100000:2.0:1789130700.508145:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857782016 00000100:00100000:2.0:1789130700.508164:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130700.508169:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857782016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789130700.508184:0:23521:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789130700.508218:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857782016:12345-0@lo:38:kworker.0 Request processed in 47us (119us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789130700.508225:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789130700.508259:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9cb4e2ed00 x1876038857782144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130700.508272:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876038857782144:0@lo:400:kworker.0 00000100:00080000:2.0:1789130700.508314:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130700.508319:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130700.508323:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857782016:0@lo:38:kworker.0 00000100:00100000:2.0:1789130700.508342:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857781888:0@lo:400:kworker.0 00000100:00100000:1.0:1789130700.705472:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00000020:01000004:3.0:1789130701.115599:0:24252:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789130701.115604:0:24252:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789130701.115605:0:24252:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789130701.115768:0:24252:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9b82102800 00000020:01000004:3.0:1789130701.115786:0:24252:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1789130701.115800:0:24252:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789130701.115814:0:24252:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9e9cb3d48000) 00000020:00000080:3.0:1789130701.115831:0:24252:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1789130701.208806:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789130701.216726:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789130701.221762:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789130701.226759:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789130701.227054:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789130701.228017:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789130701.232178:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789130701.233028:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789130701.233317:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789130701.233577:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789130701.233938:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789130701.234187:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789130701.234562:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789130701.234927:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789130701.235205:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789130701.237338:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789130701.237578:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789130701.237904:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789130701.238114:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789130701.238319:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789130701.239358:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789130701.239673:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789130701.239946:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789130701.240278:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789130701.241340:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789130701.245066:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789130701.246127:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789130701.246504:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.247436:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.248003:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.248317:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.248725:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.248942:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.249149:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.249447:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.250531:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.251344:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.251634:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.251855:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.252051:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.252696:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.252966:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.253285:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.253938:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.254186:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789130701.254833:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789130701.255069:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00080000:01000000:1.0:1789130701.256504:0:24252:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789130701.256976:0:24252:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789130701.256989:0:24252:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789130701.257002:0:24252:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76b2fec9b05094ab 00000020:01000004:1.0:1789130701.257010:0:24252:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789130701.257030:0:24252:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.110@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789130701.257034:0:24252:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789130701.257040:0:24252:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789130701.257066:0:24252:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1789130701.257071:0:24252:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789130701.269609:0:24252:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789130701.269968:0:24252:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.110@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789130701.269973:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789130701.269975:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789130701.269977:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130701.269978:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130701.269979:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130701.269980:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130701.269981:0:24252:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130701.269983:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130701.269984:0:24252:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789130701.269989:0:24252:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789130701.269992:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789130701.269993:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789130701.269994:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130701.269995:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130701.269996:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130701.269997:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130701.269998:0:24252:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130701.269999:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130701.270000:0:24252:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789130701.270033:0:24252:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789130701.270057:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782272:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789130701.270133:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.270241:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91e27240 going to sleep for 11 seconds 00000100:00100000:3.0:1789130701.270992:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857782272 00000100:00100000:3.0:1789130701.271002:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857782272 00000100:00100000:3.0:1789130701.271105:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789130701.271115:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:24252:x1876038857782272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789130701.271150:0:23510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789130701.271153:0:23510:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789130701.271161:0:23510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789130701.271793:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:24252:x1876038857782272:12345-0@lo:253:mount.lustre.0 Request processed in 678us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130701.271856:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789130701.271960:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789130701.271973:0:24252:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789130701.271976:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789130701.271978:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789130701.271980:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130701.271981:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130701.271982:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130701.271983:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130701.271985:0:24252:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130701.271987:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130701.272002:0:24252:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789130701.272024:0:24252:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9b82102800 from lustre-MDT0001 10000000:01000000:0.0:1789130701.272055:0:24252:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789130701.272058:0:24252:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789130701.272065:0:24252:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e9b841b1a48 local copy 00010000:00010000:0.0:1789130701.272076:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130701.272175:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130701.272226:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.274133:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83362480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.274204:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857782400 00000100:00100000:2.0:1789130701.274212:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857782400 00000100:00100000:2.0:1789130701.274265:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789130701.274275:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:24252:x1876038857782400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130701.274406:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:24252:x1876038857782400:12345-0@lo:501:mount.lustre.0 Request processed in 132us (2179us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130701.274412:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130701.274503:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782400:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789130701.274528:0:24252:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789130701.274554:0:24252:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789130701.274564:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.274574:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130701.274604:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9b82102800 10000000:01000000:0.0:1789130701.274609:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789130701.274641:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e9b841b1a48 10000000:01000000:0.0:1789130701.274645:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789130701.274648:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e9b841b1a48 from 1 10000000:01000000:0.0:1789130701.274651:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789130701.274683:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b000/0x76b2fec9b05094b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.274691:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b000/0x76b2fec9b05094b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.274748:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b000/0x76b2fec9b05094b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130701.274768:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130701.274812:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.274829:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83362480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.275060:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857782528 00000100:00100000:2.0:1789130701.275065:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857782528 00000100:00100000:2.0:1789130701.275087:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130701.275093:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+12:24252:x1876038857782528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130701.275102:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130701.275116:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a92200/0x76b2fec9b05094b9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05094b2 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.275138:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a92200/0x76b2fec9b05094b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05094b2 expref: 13 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.275148:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a92200/0x76b2fec9b05094b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05094b2 expref: 13 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.275156:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a92200, rc 0) 00000100:00100000:2.0:1789130701.275213:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+13:24252:x1876038857782528:12345-0@lo:101:mount.lustre.0 Request processed in 119us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.275219:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130701.275392:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130701.275405:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b000/0x76b2fec9b05094b2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094b9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.275414:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b000/0x76b2fec9b05094b2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05094b9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130701.275433:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789130701.275452:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b000/0x76b2fec9b05094b2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094b9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.275460:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b000/0x76b2fec9b05094b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094b9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130701.275467:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e9b82102800 10000000:01000000:0.0:1789130701.275471:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789130701.275474:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e9b82102800 from 1 10000000:01000000:0.0:1789130701.275486:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789130701.275505:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b800/0x76b2fec9b05094c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.275511:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b800/0x76b2fec9b05094c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.275527:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b800/0x76b2fec9b05094c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130701.275541:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130701.275569:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.275582:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83362480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.275698:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857782656 00000100:00100000:2.0:1789130701.275702:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857782656 00000100:00100000:2.0:1789130701.275733:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789130701.275739:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+13:24252:x1876038857782656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130701.275747:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130701.275755:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a92600/0x76b2fec9b05094c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05094c0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.275767:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a92600/0x76b2fec9b05094c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05094c0 expref: 14 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.275775:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a92600/0x76b2fec9b05094c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05094c0 expref: 14 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.275781:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a92600, rc 0) 00000100:00100000:2.0:1789130701.275822:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+14:24252:x1876038857782656:12345-0@lo:101:mount.lustre.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.275828:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130701.276131:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130701.276143:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b800/0x76b2fec9b05094c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094c7 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.276150:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b800/0x76b2fec9b05094c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05094c7 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130701.276160:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789130701.276175:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b800/0x76b2fec9b05094c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094c7 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.276182:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6b800/0x76b2fec9b05094c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094c7 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130701.276188:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789130701.276191:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789130701.276204:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e9b82102800 10000000:01000000:0.0:1789130701.276207:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789130701.276209:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789130701.276211:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789130701.276224:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a800/0x76b2fec9b05094ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.276238:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a800/0x76b2fec9b05094ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.276245:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a800/0x76b2fec9b05094ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130701.276258:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130701.276283:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.276295:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83362480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.276955:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857782784 00000100:00100000:2.0:1789130701.276963:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857782784 00000100:00100000:2.0:1789130701.276994:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789130701.277003:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+14:24252:x1876038857782784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130701.277013:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130701.277025:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a93600/0x76b2fec9b05094d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05094ce expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.277055:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a93600/0x76b2fec9b05094d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05094ce expref: 15 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.277065:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a93600/0x76b2fec9b05094d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05094ce expref: 15 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.277072:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a93600, rc 0) 00000100:00100000:2.0:1789130701.277121:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857782784:12345-0@lo:101:mount.lustre.0 Request processed in 119us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.277127:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130701.277196:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130701.277208:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a800/0x76b2fec9b05094ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094d5 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.277217:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a800/0x76b2fec9b05094ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05094d5 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130701.280896:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1789130701.281587:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130701.292454:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789130701.292606:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1789130701.293403:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1789130701.293421:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1789130701.293437:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1789130701.293455:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1789130701.293469:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1789130701.293929:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1789130701.293955:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1789130701.293968:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1789130701.293999:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1789130701.294013:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1789130701.294025:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1789130701.294039:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1789130701.294051:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1789130701.294066:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1789130701.294081:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1789130701.294095:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1789130701.294109:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1789130701.294122:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1789130701.294135:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1789130701.294152:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1789130701.294166:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1789130701.294179:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1789130701.294191:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1789130701.295344:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1789130701.295369:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1789130701.295384:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1789130701.295400:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1789130701.295416:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1789130701.295433:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1789130701.295451:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1789130701.295466:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1789130701.295479:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1789130701.295492:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1789130701.295504:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1789130701.295530:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1789130701.295545:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1789130701.295560:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1789130701.295574:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1789130701.295588:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1789130701.295602:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1789130701.295645:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1789130701.295677:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1789130701.295716:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1789130701.295723:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1789130701.295843:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130701.295914:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.297367:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83362cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.299899:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857782912 00000100:00100000:2.0:1789130701.299918:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857782912 00000100:00100000:3.0:1789130701.300090:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130701.300104:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857782912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130701.300362:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857782912:12345-0@lo:501:mount.lustre.0 Request processed in 261us (4447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130701.300371:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789130701.300413:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857782912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130701.300483:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857783040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130701.300531:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.300572:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83362cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130701.300641:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857783040 00000100:00100000:1.0:1789130701.300645:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857783040 00000100:00100000:1.0:1789130701.300678:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789130701.300686:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857783040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130701.301481:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857783040:12345-0@lo:503:mount.lustre.0 Request processed in 793us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130701.301490:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789130701.302495:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857783040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789130701.303088:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130701.303181:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857783168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130701.303255:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130701.303306:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91f08480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.303605:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857783168 00000100:00100000:2.0:1789130701.303638:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857783168 00000100:00100000:2.0:1789130701.303690:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130701.303701:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c851e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857783168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130701.308535:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c851e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857783168:12345-0@lo:502:mount.lustre.0 Request processed in 4825us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130701.308733:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857783168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130701.309003:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789130701.309036:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1789130701.309051:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1789130701.309064:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1789130701.309077:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1789130701.309091:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1789130701.309105:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1789130701.309117:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1789130701.309133:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1789130701.309147:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1789130701.309159:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1789130701.309172:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1789130701.309183:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1789130701.309194:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1789130701.309207:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1789130701.309221:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1789130701.309234:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1789130701.309248:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1789130701.309259:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1789130701.309285:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1789130701.309298:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1789130701.309310:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1789130701.309322:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1789130701.309334:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1789130701.309347:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1789130701.309360:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1789130701.309372:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1789130701.309384:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1789130701.309396:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1789130701.309410:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1789130701.309425:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1789130701.309438:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1789130701.309451:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1789130701.309464:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1789130701.309475:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1789130701.309487:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1789130701.309499:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1789130701.309513:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1789130701.309525:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1789130701.309537:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1789130701.309702:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1789130701.309735:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1789130701.309749:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1789130701.309761:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1789130701.309801:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857783296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130701.309866:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130701.309901:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82a30780 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.310039:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130701.310087:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857783296 00000100:00100000:2.0:1789130701.310093:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857783296 00000100:00100000:2.0:1789130701.310144:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789130701.310153:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c851e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857783296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130701.310274:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c851e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857783296:12345-0@lo:502:mount.lustre.0 Request processed in 121us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.310281:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130701.310827:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857783296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130701.310892:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789130701.310903:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789130701.312164:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130701.312178:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130701.312181:0:24256:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789130701.312188:0:24256:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789130701.312191:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130701.312221:0:24256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9e9cb3d4b490) 00000020:00000080:3.0:1789130701.312249:0:24256:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789130701.312256:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789130701.312344:0:24256:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789130701.312351:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76b2fec9b05094e3 00000020:00000080:3.0:1789130701.312582:0:24256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789130701.312587:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130701.312591:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130701.312592:0:24256:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789130701.312595:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130701.312599:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130701.312600:0:24256:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789130701.312603:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130701.312634:0:24256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9e9cb3d4ced8) 00000020:00000080:3.0:1789130701.312648:0:24256:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789130701.312653:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789130701.312655:0:24256:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789130701.312659:0:24256:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789130701.312665:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789130701.312721:0:24256:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b82102800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789130701.312737:0:24256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9e9cb4ef9a48) 00000020:00000080:3.0:1789130701.312745:0:24256:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789130701.312821:0:24256:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789130701.312838:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76b2fec9b05094f8 00000020:00000080:3.0:1789130701.312944:0:24256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789130701.312953:0:24256:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789130701.312958:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x76b2fec9b05094ff 00080000:01000000:3.0:1789130701.312964:0:24256:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789130701.312975:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76b2fec9b0509506 00010000:00010000:0.0:1789130701.417152:0:24256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789130701.418224:0:24256:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1789130701.418691:0:24256:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789130701.420014:0:24256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789130701.420029:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130701.420035:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130701.420038:0:24256:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789130701.420042:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130701.420048:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130701.420050:0:24256:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789130701.420053:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789130701.420064:0:24256:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:00000080:1.0:1789130701.420094:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789130701.420111:0:24256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9e9b82bbced8) 00000020:00000080:1.0:1789130701.420136:0:24256:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789130701.420142:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789130701.420218:0:24256:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789130701.420226:0:24256:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789130701.420236:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76b2fec9b0509514 00010000:00080000:1.0:1789130701.420275:0:24256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9cb3dc2800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.110@tcp at head 00010000:00010000:1.0:1789130701.422466:0:24256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789130701.423748:0:24256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789130701.423761:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789130701.423904:0:24256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789130701.423928:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76b2fec9b050951b 00000100:00080000:0.0:1789130701.423939:0:24256:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130701.423944:0:24256:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e9cb3dc2800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130701.423977:0:24256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359cb40 x1876038857783424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130701.424009:0:24256:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789130701.424037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789130701.424041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789130701.424043:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130701.424047:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 719 00000100:00080000:0.0:1789130701.424057:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789130701.424061:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e9c90991800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130701.424075:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359d2c0 x1876038857783552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130701.424084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130701.424087:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789130701.424090:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130701.424093:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789130701.424131:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876038857783680:0@lo:400:kworker.0 00000100:00100000:0.0:1789130701.424197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.424250:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857783680 00000100:00100000:0.0:1789130701.424257:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857783680 00000100:00100000:0.0:1789130701.424299:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130701.424308:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876038857783680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130701.424360:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876038857783680:12345-0@lo:400:kworker.0 Request processed in 53us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.424367:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789130701.424403:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9cb359e580 x1876038857783680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130701.424414:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876038857783680:0@lo:400:kworker.0 00000020:01000000:0.0:1789130701.424463:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130701.424467:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.424469:0:24256:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789130701.424472:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789130701.424474:0:24256:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789130701.424482:0:24256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130701.424484:0:24256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130701.424486:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789130701.424489:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.424490:0:24256:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789130701.424493:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130701.424497:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.424499:0:24256:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789130701.424502:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789130701.424539:0:24256:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789130701.424649:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857783424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130701.424687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130701.424729:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857783552:0@lo:38:kworker.0 00000100:00100000:1.0:1789130701.424772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130701.424818:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857783424 00000100:00100000:1.0:1789130701.424821:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857783424 00000100:00100000:1.0:1789130701.424834:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857783552 00000100:00100000:1.0:1789130701.424837:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857783552 00000100:00100000:1.0:1789130701.424847:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130701.424852:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857783424:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789130701.424873:0:23521:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 720 last 0 00000020:00000080:1.0:1789130701.424907:0:23521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76b2fec9b0509522 00000004:00100000:1.0:1789130701.424924:0:23521:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789130701.424930:0:23521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:0.0:1789130701.425169:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130701.425173:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.425175:0:24256:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789130701.425178:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789130701.425180:0:24256:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1789130701.425182:0:24256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130701.425183:0:24256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130701.425185:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789130701.425187:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.425189:0:24256:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789130701.425191:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789130701.425195:0:24256:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789130701.425199:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.425200:0:24256:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789130701.425203:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789130701.425207:0:24256:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:01000000:0.0:1789130701.425229:0:24256:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789130701.425232:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789130701.425246:0:24256:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e9cad8b8000) 00000020:00000080:0.0:1789130701.425260:0:24256:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789130701.425266:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789130701.425342:0:24256:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789130701.425350:0:24256:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789130701.425361:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76b2fec9b0509530 00010000:00080000:0.0:1789130701.425389:0:24256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9c90d66800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.110@tcp at head 00010000:00010000:0.0:1789130701.428006:0:24256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1789130701.431523:0:24256:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789130701.434413:0:24256:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789130701.436060:0:23521:0:(import.c:65:import_set_state_nolock()) ffff9e9b842e5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130701.436209:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1876038857783424:12345-0@lo:38:llog_process_th.0 Request processed in 11353us (11518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130701.436227:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130701.436264:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130701.436271:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857783552:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789130701.436317:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857783552:12345-0@lo:38:kworker.0 Request processed in 44us (11543us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789130701.436323:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789130701.445157:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130701.445175:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789130701.445185:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789130701.445210:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789130701.445215:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cb3dc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789130701.445232:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857783424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130701.445249:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130701.445254:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130701.445257:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789130701.445260:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857783552:0@lo:38:kworker.0 00000100:00100000:1.0:1789130701.445349:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130701.445365:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857783808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130701.445423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130701.445463:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857783808 00000100:00100000:1.0:1789130701.445468:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857783808 00000100:00100000:1.0:1789130701.445512:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130701.445521:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876038857783808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130701.445553:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789130701.445596:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876038857783808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130701.445604:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130701.445657:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857783808:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789130701.447442:0:24256:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130701.447730:0:24256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789130701.447937:0:24256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789130701.451310:0:24261:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789130701.451319:0:24261:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789130701.467306:0:24256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789130701.467321:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789130701.467365:0:24256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789130701.467386:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76b2fec9b0509537 00000100:00080000:0.0:1789130701.467398:0:24256:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130701.467406:0:24256:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e9c90d66800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130701.467445:0:24256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359e580 x1876038857783936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130701.467480:0:24256:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789130701.467591:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857783936:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789130701.467698:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857783936 offset 0 length 520: 4 00000020:01000000:0.0:1789130701.468090:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130701.468096:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.468098:0:24256:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789130701.468101:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789130701.468105:0:24256:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789130701.468107:0:24256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130701.468108:0:24256:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130701.468110:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789130701.468112:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.468114:0:24256:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789130701.468117:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789130701.468121:0:24256:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789130701.468125:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.468127:0:24256:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789130701.468129:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789130701.468133:0:24256:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:01000000:0.0:1789130701.468158:0:24256:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789130701.468161:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789130701.468185:0:24256:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e9cad8bced8) 00000020:00000080:0.0:1789130701.468202:0:24256:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789130701.468208:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789130701.468278:0:24256:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789130701.468285:0:24256:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789130701.468292:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76b2fec9b0509545 00010000:00080000:0.0:1789130701.468331:0:24256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9b82105000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.110@tcp at head 00010000:00010000:0.0:1789130701.468573:0:24256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789130701.468665:0:24256:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789130701.468683:0:24256:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789130701.471559:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130701.471569:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130701.471572:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130701.471575:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789130701.472002:0:24256:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130701.472307:0:24256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789130701.472428:0:24256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1789130701.473176:0:24263:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789130701.473182:0:24263:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789130701.481361:0:24256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789130701.481382:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789130701.481433:0:24256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789130701.481458:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76b2fec9b050954c 00000100:00080000:0.0:1789130701.481470:0:24256:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130701.481477:0:24256:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e9b82105000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130701.481515:0:24256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359f480 x1876038857784064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130701.481556:0:24256:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789130701.484114:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130701.484126:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.484128:0:24256:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789130701.484133:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130701.484138:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.484139:0:24256:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789130701.484142:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789130701.484159:0:24256:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789130701.484162:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130701.484165:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.484166:0:24256:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789130701.484168:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130701.484170:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.484172:0:24256:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789130701.484176:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789130701.484218:0:24256:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130701.484221:0:24256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130701.484223:0:24256:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789130701.484226:0:24256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1789130701.484376:0:24252:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789130701.484407:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789130701.484424:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a800/0x76b2fec9b05094ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094d5 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.484437:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a800/0x76b2fec9b05094ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05094d5 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130701.484445:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b82102800 from 1 10000000:01000000:0.0:1789130701.484448:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130701.484486:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.484494:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.484504:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130701.484526:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789130701.484652:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.484695:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83362b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.484732:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857784192 00000100:00100000:0.0:1789130701.484740:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857784192 00000100:00100000:0.0:1789130701.484785:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789130701.485083:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857784064:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789130701.485135:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857784064 offset 0 length 520: 4 00000100:00100000:0.0:1789130701.485742:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+15:24252:x1876038857784192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130701.485765:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130701.485786:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b0509553 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.485892:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 16 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.485904:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 16 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.485914:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9cb4e6b400, rc 0) 00000100:00100000:0.0:1789130701.486026:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:24252:x1876038857784192:12345-0@lo:101:mount.lustre.0 Request processed in 1232us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.486036:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789130701.492264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130701.492277:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789130701.492280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130701.492284:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789130701.492941:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130701.492974:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.492988:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130701.493636:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784320:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789130701.493732:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.493791:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83362cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130701.493976:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857784320 00000100:00100000:1.0:1789130701.493983:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857784320 00000100:00100000:1.0:1789130701.494041:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789130701.494051:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:24252:x1876038857784320:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789130701.494074:0:23509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789130701.494092:0:23509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789130701.494095:0:23509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789130701.494203:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:24252:x1876038857784320:12345-0@lo:256:mount.lustre.0 Request processed in 154us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130701.494211:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130701.494315:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784320:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789130701.495068:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789130701.495157:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.495169:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130701.495179:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b82102800 from 1 10000000:01000000:2.0:1789130701.495182:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130701.495216:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.495225:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.495234:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130701.495257:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789130701.495306:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130701.495354:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.495441:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857784448 00000100:00100000:0.0:1789130701.495447:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857784448 00000100:00100000:0.0:1789130701.495494:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789130701.495502:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:24252:x1876038857784448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130701.495515:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130701.495531:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b0509561 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.495571:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 17 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.495583:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 17 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.495593:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9cb4e6b200, rc 0) 00000100:00100000:0.0:1789130701.495647:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784448:12345-0@lo:101:mount.lustre.0 Request processed in 146us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.495655:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789130701.495852:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130701.495868:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.495878:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130701.497147:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000040:00080000:2.0:1789130701.497416:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130701.498232:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789130701.498272:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1789130701.498289:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1789130701.498304:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1789130701.498320:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1789130701.498334:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1789130701.498366:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1789130701.498380:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 144 off9680 00000040:00080000:2.0:1789130701.498390:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9904 00000040:00080000:2.0:1789130701.498401:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10128 00000040:00080000:2.0:1789130701.498414:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 144 off10272 00000040:00080000:2.0:1789130701.498426:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10496 00000040:00080000:2.0:1789130701.498441:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 224 off10720 00000040:00080000:2.0:1789130701.498455:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10848 00000040:00080000:2.0:1789130701.498469:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off11072 00000040:00080000:2.0:1789130701.498483:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11296 00000040:00080000:2.0:1789130701.498496:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 128 off11424 00000040:00080000:2.0:1789130701.498515:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11648 00000040:00080000:2.0:1789130701.498521:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 18 count 19 00000100:00100000:2.0:1789130701.498662:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130701.498739:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130701.498790:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.499100:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857784576 00000100:00100000:0.0:1789130701.499109:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857784576 00000100:00100000:0.0:1789130701.499163:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789130701.499172:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130701.499297:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784576:12345-0@lo:501:mount.lustre.0 Request processed in 127us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.499305:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789130701.499530:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130701.499586:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130701.499660:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130701.499687:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.499788:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857784704 00000100:00100000:0.0:1789130701.499804:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857784704 00000100:00100000:0.0:1789130701.499827:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789130701.499841:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130701.499923:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784704:12345-0@lo:503:mount.lustre.0 Request processed in 83us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.499930:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789130701.499972:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789130701.500360:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789130701.500427:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130701.500467:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.500494:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857784832 00000100:00100000:0.0:1789130701.500498:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857784832 00000100:00100000:0.0:1789130701.500518:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130701.500525:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130701.500597:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784832:12345-0@lo:502:mount.lustre.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.500604:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130701.500694:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82a30780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.500716:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789130701.500882:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789130701.500910:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1789130701.500923:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1789130701.500936:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1789130701.500949:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1789130701.500964:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1789130701.500979:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1789130701.500991:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 144 off9680 00000040:00080000:0.0:1789130701.501004:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9904 00000040:00080000:0.0:1789130701.501017:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10128 00000040:00080000:0.0:1789130701.501040:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 144 off10272 00000040:00080000:0.0:1789130701.501053:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10496 00000040:00080000:0.0:1789130701.501065:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 224 off10720 00000040:00080000:0.0:1789130701.501078:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10848 00000040:00080000:0.0:1789130701.501090:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off11072 00000040:00080000:0.0:1789130701.501101:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11296 00000040:00080000:0.0:1789130701.501111:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 128 off11424 00000100:00100000:0.0:1789130701.501131:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130701.501171:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.501194:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857784960 00000100:00100000:0.0:1789130701.501198:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857784960 00000100:00100000:0.0:1789130701.501219:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130701.501225:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130701.501284:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857784960:12345-0@lo:502:mount.lustre.0 Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.501290:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130701.501318:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c86eb1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.501331:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857784960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789130701.501365:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11648 00000040:00080000:0.0:1789130701.501372:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:2.0:1789130701.503740:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130701.503757:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503760:0:24265:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789130701.503768:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b82102800 00000020:00000080:2.0:1789130701.503771:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130701.503780:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130701.503783:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503784:0:24265:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789130701.503786:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130701.503788:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503790:0:24265:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789130701.503806:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9b82102800 00000020:00000080:2.0:1789130701.503808:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130701.503879:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130701.503883:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503885:0:24265:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789130701.503887:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130701.503890:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503891:0:24265:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130701.503895:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b82102800 00000020:00000080:2.0:1789130701.503898:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130701.503916:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130701.503918:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503919:0:24265:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130701.503922:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130701.503924:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503925:0:24265:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130701.503928:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b82102800 00000020:00000080:2.0:1789130701.503930:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130701.503945:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130701.503948:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503949:0:24265:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130701.503970:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130701.503972:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.503974:0:24265:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789130701.503977:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b82102800 00000020:00000080:2.0:1789130701.503979:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130701.503998:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130701.504001:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.504002:0:24265:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789130701.504005:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130701.504007:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.504008:0:24265:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789130701.504011:0:24265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9b82102800 00000020:00000080:2.0:1789130701.504013:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130701.504034:0:24265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130701.504037:0:24265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130701.504039:0:24265:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789130701.504042:0:24265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 19 count 19 00000020:01000000:1.0:1789130701.504227:0:24252:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789130701.504256:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130701.504283:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.504307:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130701.504364:0:24252:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789130701.504367:0:24252:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9b82102800 10000000:01000000:1.0:1789130701.504369:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9b82102800 10000000:01000000:1.0:1789130701.504373:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789130701.504379:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9b82102800 from 1 10000000:01000000:1.0:1789130701.504381:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789130701.504416:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83982000/0x76b2fec9b050956f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.504425:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83982000/0x76b2fec9b050956f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.504435:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83982000/0x76b2fec9b050956f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130701.504459:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789130701.504533:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130701.504583:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.504982:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857785088 00000100:00100000:2.0:1789130701.504990:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857785088 00000100:00100000:2.0:1789130701.505043:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789130701.505053:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:24252:x1876038857785088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130701.505068:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130701.505082:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a92c00/0x76b2fec9b0509576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050956f expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.505108:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a92c00/0x76b2fec9b0509576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050956f expref: 18 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.505120:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a92c00/0x76b2fec9b0509576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050956f expref: 18 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.505129:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a92c00, rc 0) 00000100:00100000:2.0:1789130701.505194:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785088:12345-0@lo:101:mount.lustre.0 Request processed in 142us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.505201:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789130701.505302:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130701.505320:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83982000/0x76b2fec9b050956f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509576 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130701.505329:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83982000/0x76b2fec9b050956f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509576 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130701.513159:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789130701.513571:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130701.513858:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789130701.513887:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789130701.513903:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789130701.513918:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789130701.513930:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789130701.513944:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789130701.513959:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789130701.513974:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789130701.513989:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789130701.514003:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789130701.514019:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789130701.514046:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789130701.514061:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789130701.514076:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789130701.514091:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789130701.514105:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789130701.514137:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789130701.514153:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789130701.514168:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789130701.514182:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789130701.514197:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789130701.514212:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789130701.514225:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789130701.514239:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789130701.514251:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789130701.514265:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789130701.514280:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789130701.514293:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789130701.514306:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789130701.514319:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789130701.514332:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789130701.514346:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789130701.514374:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789130701.514392:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789130701.514407:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789130701.514420:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789130701.514432:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789130701.514447:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789130701.514459:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789130701.514473:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789130701.514488:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789130701.514502:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789130701.514516:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789130701.514530:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789130701.514556:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789130701.514570:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789130701.514583:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789130701.514596:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789130701.514787:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789130701.514810:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789130701.514827:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789130701.514832:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789130701.514944:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130701.515020:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130701.515069:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82beb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.515272:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857785216 00000100:00100000:2.0:1789130701.515282:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857785216 00000100:00100000:2.0:1789130701.515333:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789130701.515342:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130701.515463:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785216:12345-0@lo:501:mount.lustre.0 Request processed in 122us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.515470:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789130701.521676:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130701.521760:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130701.522002:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130701.522047:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82beb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.522715:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857785344 00000100:00100000:2.0:1789130701.522723:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857785344 00000100:00100000:2.0:1789130701.522779:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789130701.522788:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785344:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130701.523069:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785344:12345-0@lo:503:mount.lustre.0 Request processed in 282us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.523077:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789130701.523137:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789130701.528449:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789130701.528689:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130701.528781:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130701.528895:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82b4c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130701.529441:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857785472 00000100:00100000:3.0:1789130701.529450:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857785472 00000100:00100000:3.0:1789130701.529508:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789130701.529518:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130701.529695:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785472:12345-0@lo:502:mount.lustre.0 Request processed in 178us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130701.529713:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789130701.535053:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789130701.535330:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1789130701.535366:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1789130701.535379:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1789130701.535403:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1789130701.535416:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1789130701.535427:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1789130701.535438:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1789130701.535449:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1789130701.535476:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1789130701.535491:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1789130701.535503:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1789130701.535514:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1789130701.535526:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1789130701.535539:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1789130701.535551:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1789130701.535564:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1789130701.535577:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1789130701.535590:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1789130701.535603:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1789130701.535639:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1789130701.535654:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1789130701.535668:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1789130701.535680:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1789130701.535692:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1789130701.535731:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1789130701.535747:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1789130701.535761:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1789130701.535776:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1789130701.535789:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1789130701.538135:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1789130701.538167:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1789130701.538184:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1789130701.538197:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1789130701.538210:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1789130701.538225:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1789130701.538240:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1789130701.538267:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1789130701.538284:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1789130701.538301:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1789130701.538317:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1789130701.538352:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1789130701.538370:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1789130701.538386:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1789130701.538402:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1789130701.538419:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1789130701.538435:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1789130701.538451:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1789130701.538467:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1789130701.538536:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130701.538665:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130701.538735:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82b4c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.538778:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857785600 00000100:00100000:2.0:1789130701.538786:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857785600 00000100:00100000:2.0:1789130701.543528:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789130701.544635:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130701.545733:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785600:12345-0@lo:502:mount.lustre.0 Request processed in 2187us (7064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.545747:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789130701.546026:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789130701.546297:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1789130701.546329:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1789130701.546371:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130701.546429:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130701.546466:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82b4c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.546491:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857785728 00000100:00100000:2.0:1789130701.546497:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857785728 00000100:00100000:2.0:1789130701.546531:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789130701.546538:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9433ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130701.551231:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9433ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785728:12345-0@lo:502:mount.lustre.0 Request processed in 4682us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130701.551249:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789130701.551346:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789130701.551434:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1789130701.551452:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789130701.559224:0:24269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789130701.559242:0:24269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9e9b830b4ed8) 00000020:00000080:2.0:1789130701.559266:0:24269:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789130701.559349:0:24269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9b82102800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789130701.559354:0:24269:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9b82102800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789130701.559356:0:24269:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9b82102800 3 00010000:00080000:2.0:1789130701.559389:0:24269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9c8472a000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.110@tcp at head 00010000:00010000:2.0:1789130701.568139:0:24269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789130701.568365:0:24269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789130701.568414:0:24269:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789130701.568428:0:24269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x76b2fec9b0509584 00000100:00080000:2.0:1789130701.568441:0:24269:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130701.568449:0:24269:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e9c8472a000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130701.568491:0:24269:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2ed00 x1876038857785856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130701.568580:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876038857785856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789130701.568680:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789130701.569635:0:24269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1789130701.572663:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1789130701.572764:0:24252:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789130701.572876:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789130701.572895:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83982000/0x76b2fec9b050956f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509576 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130701.572908:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83982000/0x76b2fec9b050956f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509576 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789130701.572960:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789130701.572962:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789130701.572963:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130701.572964:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130701.572965:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130701.572967:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130701.572968:0:24252:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789130701.572970:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130701.572971:0:24252:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130701.572974:0:24252:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789130701.572976:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789130701.572977:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789130701.572978:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130701.572979:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130701.572980:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130701.572981:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130701.572982:0:24252:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789130701.572983:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130701.572984:0:24252:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130701.573008:0:24252:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789130701.573027:0:24252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789130701.573097:0:24252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130701.573132:0:24252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82b4ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130701.573153:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857785984 00000100:00100000:2.0:1789130701.573159:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857785984 00000100:00100000:2.0:1789130701.573199:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789130701.573209:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789130701.573246:0:23510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789130701.573261:0:23510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789130701.574079:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857785856 00000100:00100000:1.0:1789130701.574088:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857785856 00000100:00100000:1.0:1789130701.574129:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130701.574135:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1876038857785856:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789130701.574160:0:23516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 720 last 0 00000020:00000080:1.0:1789130701.574204:0:23516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x76b2fec9b050958b 00000004:00100000:1.0:1789130701.574222:0:23516:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789130701.574256:0:23516:0:(import.c:65:import_set_state_nolock()) ffff9e9cada60000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130701.574335:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876038857785856:12345-0@lo:38:llog_process_th.0 Request processed in 198us (5654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130701.574342:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789130701.574384:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9cb4e2ed00 x1876038857785856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130701.574396:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130701.574403:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789130701.574411:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789130701.574416:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789130701.574418:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c8472a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789130701.574425:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876038857785856:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789130701.574453:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130701.574459:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130701.574462:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130701.574464:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000001:00100000:0.0:1789130701.577095:0:23495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789130701.577464:0:23510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789130701.577475:0:23510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789130701.578904:0:23531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789130701.578915:0:23531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789130701.578944:0:23531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.578968:0:23531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050948f expref: 18 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.578995:0:23531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 18 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.579004:0:23531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.579054:0:23531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 18 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.579072:0:23531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 18 pid: 23508 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130701.579090:0:23531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857786112:0@lo:104: 00000100:00100000:1.0:1789130701.579169:0:23531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130701.579225:0:23531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b050948f expref: 18 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.579234:0:23531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b050948f expref: 18 pid: 23509 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130701.579243:0:23531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aea1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857786240:0@lo:104: 00000100:00100000:1.0:1789130701.579264:0:23531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130701.579281:0:23531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130701.579321:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857786112 00000100:00100000:1.0:1789130701.579329:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857786112 00000100:00100000:1.0:1789130701.579366:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857786240 00000100:00100000:1.0:1789130701.579369:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857786240 00000100:00100000:1.0:1789130701.579384:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130701.579392:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:23531:x1876038857786112:12345-0@lo:104: 00010000:00010000:1.0:1789130701.579412:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.579470:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789130701.579476:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:23531:x1876038857786112:12345-0@lo:104: Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130701.579483:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130701.579501:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130701.579508:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:23531:x1876038857786240:12345-0@lo:104: 00010000:00010000:1.0:1789130701.579515:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130701.580326:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:24252:x1876038857785984:12345-0@lo:253:mount.lustre.0 Request processed in 7111us (7222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130701.580338:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130701.580402:0:24252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:24252:1876038857785984:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789130701.580415:0:24252:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789130701.580426:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130701.580428:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789130701.580430:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130701.580431:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130701.580432:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130701.580433:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130701.580434:0:24252:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130701.580436:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130701.580438:0:24252:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789130701.580456:0:24252:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789130701.580882:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789130701.580891:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:23531:x1876038857786240:12345-0@lo:104: Request processed in 1383us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130701.580898:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789130701.580926:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130701.580933:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.580942:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6aa00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130701.580946:0:23504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.580955:0:23504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130701.580962:0:23504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130701.580974:0:23504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130701.581009:0:23504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581016:0:23504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130701.581037:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581044:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6aa00/0x76b2fec9b0509553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b050955a expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581057:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130701.581060:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581065:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a93c00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130701.581068:0:23504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581074:0:23504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130701.581080:0:23504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130701.581084:0:23504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130701.581095:0:23504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581100:0:23504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130701.581122:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581128:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93c00/0x76b2fec9b050948f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509496 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581139:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130701.581141:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130701.581143:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130701.581156:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3645:1876038857786368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130701.581198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130701.581262:0:23501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857786368 00000100:00100000:1.0:1789130701.581267:0:23501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857786368 00010000:00010000:1.0:1789130701.581288:0:23501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 18 pid: 23508 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130701.581312:0:23501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130701.581320:0:23501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:3645:x1876038857786368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130701.581332:0:23501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130701.581337:0:23501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 18 pid: 23508 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581348:0:23501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 18 pid: 23508 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130701.581366:0:23501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130701.581393:0:23501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:3645:x1876038857786368:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130701.581400:0:23501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130701.581444:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3645:1876038857786368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130701.581480:0:23531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b050955a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b0509553 expref: 17 pid: 23508 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130701.581491:0:23531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aead00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857786112:0@lo:104: 00000100:00100000:1.0:1789130701.581500:0:23531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aea1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857786240:0@lo:104: 00010000:00010000:1.0:1789130701.581517:0:23531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.584933:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130701.584964:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3642:1876038857786496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130701.585043:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130701.585158:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857786496 00000100:00100000:0.0:1789130701.585166:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857786496 00010000:00010000:0.0:1789130701.585203:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050948f expref: 17 pid: 23509 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130701.585251:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130701.585259:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:3642:x1876038857786496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130701.585274:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130701.585279:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050948f expref: 17 pid: 23509 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585290:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b050948f expref: 17 pid: 23509 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585308:0:23502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b050948f expref: 17 pid: 23509 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585324:0:23502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585332:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789130701.585350:0:23502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006435243s 00010000:00010000:0.0:1789130701.585354:0:23502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585360:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585367:0:23502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585374:0:23502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585386:0:23502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130701.585390:0:23502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585399:0:23502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585412:0:23502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.585421:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130701.585455:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:3642:x1876038857786496:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.585463:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130701.585526:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3642:1876038857786496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130701.590965:0:23531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.590986:0:23531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130701.590993:0:23531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83983600/0x76b2fec9b0509592 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1789130701.628437:0:24252:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789130701.628524:0:24278:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789130701.628530:0:24278:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789130701.628896:0:24279:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789130701.629055:0:24252:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1789130701.629501:0:24279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789130701.630974:0:24252:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789130701.631016:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789130701.632294:0:24252:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789130701.632310:0:24252:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789130701.632385:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130701.637991:0:24252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789130701.638520:0:24252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789130701.638551:0:24252:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789130701.638701:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789130701.639219:0:24252:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:3.0:1789130701.639585:0:24280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24280:1876038857786624:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789130701.639684:0:24280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789130701.640476:0:24279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789130701.640554:0:24279:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1789130701.645103:0:24280:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c92704d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.646782:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857786624 00000100:00100000:0.0:1789130701.646802:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857786624 00000100:00100000:0.0:1789130701.646875:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789130701.646887:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3492d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24280:x1876038857786624:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789130701.647034:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3492d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24280:x1876038857786624:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 149us (7350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.647041:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:2.0:1789130701.648062:0:24252:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1789130701.648226:0:24280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24280:1876038857786624:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789130701.648264:0:24280:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789130701.648307:0:24280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24280:1876038857786752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789130701.648362:0:24280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130701.648392:0:24280:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c92704d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.648577:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857786752 00000100:00100000:0.0:1789130701.648583:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857786752 00000100:00100000:0.0:1789130701.648641:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130701.648649:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3491a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24280:x1876038857786752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789130701.648778:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3491a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24280:x1876038857786752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 128us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.648785:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130701.649070:0:24280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24280:1876038857786752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789130701.649164:0:24280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24280:1876038857786880:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789130701.649211:0:24280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130701.649234:0:24280:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c92704840 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.649326:0:23526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857786880 00000100:00100000:0.0:1789130701.649330:0:23526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857786880 00000100:00100000:0.0:1789130701.649361:0:23526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130701.649368:0:23526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24280:x1876038857786880:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789130701.649405:0:23526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24280:x1876038857786880:12345-0@lo:900:lod0001_rec0000.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.649412:0:23526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789130701.649473:0:24280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e9cb3490f00 x1876038857786880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789130717 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130701.649484:0:24280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24280:1876038857786880:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789130701.649522:0:24280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24280:1876038857787008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789130701.650078:0:24280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130701.650101:0:24280:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c92704d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130701.650142:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857787008 00000100:00100000:0.0:1789130701.650147:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857787008 00000100:00100000:0.0:1789130701.650181:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130701.650189:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3493c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24280:x1876038857787008:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789130701.650388:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3493c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24280:x1876038857787008:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 198us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130701.650397:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789130701.650458:0:24280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490f00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24280:1876038857787008:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789130701.650509:0:24280:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130701.656531:0:24280:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789130701.658888:0:24280:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789130701.658900:0:24280:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1789130701.687142:0:24252:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789130701.687188:0:24252:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffade7456b3988 00100000:10000000:3.0:1789130701.687209:0:24252:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789130701.695023:0:24252:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789130701.695075:0:24252:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789130701.695121:0:24252:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789130701.695151:0:24252:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789130701.695941:0:24252:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130701.696160:0:24252:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789130701.722183:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:1.0:1789130702.238012:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789130702.683907:0:24277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789130702.758104:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 10000000:01000000:0.0:1789130702.938987:0:23512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789130702.938996:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b82102800 from 12 10000000:01000000:0.0:1789130702.939002:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130702.939057:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130702.939070:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130702.939081:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130702.939109:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857787136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130702.939187:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130702.939244:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b84833480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130702.939332:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857787136 00000100:00100000:1.0:1789130702.939341:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857787136 00000100:00100000:1.0:1789130702.939401:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789130702.939412:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:23512:x1876038857787136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130702.939425:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130702.939439:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b0509599 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130702.939464:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 17 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130702.939476:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 17 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130702.939485:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83982800, rc 0) 00000100:00100000:1.0:1789130702.939534:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857787136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130702.939542:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130702.942804:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857787136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130702.942836:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130702.942850:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130702.942941:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857787264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789130702.943008:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130702.943053:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b84833480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130702.944797:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857787264 00000100:00100000:3.0:1789130702.944814:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857787264 00000100:00100000:3.0:1789130702.944878:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130702.944888:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857787264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789130702.944916:0:23510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789130702.944941:0:23510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789130702.944945:0:23510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1789130702.945081:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857787264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130702.945090:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130702.950073:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857787264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789130702.950146:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789130702.950158:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130702.950169:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130702.950180:0:23512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789130702.950183:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9cb353d000 from 12 10000000:01000000:0.0:1789130702.950185:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130702.950223:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130702.950231:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130702.950241:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130702.950263:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857787392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130702.950327:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130702.950374:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b84833480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130702.950781:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857787392 00000100:00100000:3.0:1789130702.950788:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857787392 00000100:00100000:3.0:1789130702.950845:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130702.950854:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857787392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130702.950870:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130702.950884:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05095a7 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130702.950909:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 18 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130702.950919:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 18 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130702.950991:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb95200, rc 0) 00000100:00100000:3.0:1789130702.951114:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:23512:x1876038857787392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130702.951122:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789130702.951261:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857787392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130702.951275:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130702.951284:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130702.951349:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857787520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789130702.951381:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130702.951444:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b84833480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130702.953311:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857787520 00000100:00100000:1.0:1789130702.953322:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857787520 00000100:00100000:1.0:1789130702.953373:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789130702.953383:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:23512:x1876038857787520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789130702.953406:0:23509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789130702.953424:0:23509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789130702.953427:0:23509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789130702.953545:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:23512:x1876038857787520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130702.953553:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789130702.953600:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857787520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789130702.953907:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789130702.953917:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130702.953939:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130703.263883:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130703.717565:0:24277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789130703.768885:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:1.0:1789130704.281102:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130704.793113:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:3.0:1789130705.304787:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130705.821495:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 0 seconds 00010000:00010000:0.0:1789130706.329787:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130706.651876:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130706.651902:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857787648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130706.651986:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130706.652075:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857787648 00000100:00100000:1.0:1789130706.652082:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857787648 00000100:00100000:1.0:1789130706.652131:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130706.652139:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857787648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130706.652191:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789130706.652240:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857787648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130706.652248:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130706.652300:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857787648:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789130706.652608:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789130706.652630:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789130706.652640:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130706.652647:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e9c90991800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130706.652677:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359e940 x1876038857787904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130706.652692:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130706.652695:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789130706.652697:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130706.652700:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789130706.652709:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130706.652711:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789130706.652713:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130706.652716:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789130706.654508:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857787776:0@lo:400:kworker.0 00000100:00100000:1.0:1789130706.654573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130706.654652:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130706.654667:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857788032:0@lo:400:kworker.0 00000100:00100000:1.0:1789130706.654693:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130706.654726:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857787904:0@lo:38:kworker.0 00000100:00100000:1.0:1789130706.654910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130706.654943:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857788032 00000100:00100000:1.0:1789130706.654950:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857788032 00000100:00100000:1.0:1789130706.654989:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130706.654997:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857788032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130706.655054:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857788032:12345-0@lo:400:kworker.0 Request processed in 58us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130706.655061:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130706.655085:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857787904 00000100:00100000:1.0:1789130706.655088:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857787904 00000100:00100000:1.0:1789130706.655102:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130706.655106:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876038857787904:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789130706.655128:0:23521:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:1.0:1789130706.655160:0:23521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76b2fec9b05095b5 00000004:00100000:1.0:1789130706.655184:0:23521:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789130706.655189:0:23521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:1.0:1789130706.655275:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb359f840 x1876038857788032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130706.655290:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857788032:0@lo:400:kworker.0 00000100:00100000:1.0:1789130706.655313:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857788160:0@lo:400:kworker.0 00000100:00100000:1.0:1789130706.655336:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130706.655363:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857788160 00000100:00100000:1.0:1789130706.655366:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857788160 00000100:00100000:1.0:1789130706.655397:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130706.655403:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857788160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130706.655432:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857788160:12345-0@lo:400:kworker.0 Request processed in 29us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130706.655438:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789130706.655459:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb359e1c0 x1876038857788160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130706.655468:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857788160:0@lo:400:kworker.0 00000100:00100000:0.0:1789130706.655675:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857787776 00000100:00100000:0.0:1789130706.655680:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857787776 00000100:00100000:0.0:1789130706.655714:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789130706.655719:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:3644:x1876038857787776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130706.655774:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:3644:x1876038857787776:12345-0@lo:400:kworker.0 Request processed in 54us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130706.655781:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789130706.656496:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857787776:0@lo:400:kworker.0 00000100:00080000:2.0:1789130706.688407:0:23521:0:(import.c:65:import_set_state_nolock()) ffff9e9c8472b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130706.688532:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876038857787904:12345-0@lo:38:kworker.0 Request processed in 33422us (33619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130706.688546:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789130706.688991:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789130706.689013:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789130706.689020:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789130706.689023:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90991800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789130706.689045:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007840586d): req@ffff9e9cb4e2fc00 x1876038857780480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130706.692922:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857788288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130706.693013:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130706.693076:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857788288 00000100:00100000:3.0:1789130706.693083:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857788288 00000100:00100000:3.0:1789130706.693129:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130706.693138:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3490f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857788288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130706.693186:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789130706.693235:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3490f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857788288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130706.693243:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130706.693290:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857788288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130706.696294:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857787904:0@lo:38:kworker.0 00000100:00100000:1.0:1789130706.697547:0:23559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130706.697592:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883add80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130706.697756:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857780480 00000100:00100000:2.0:1789130706.697766:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857780480 00000100:00100000:2.0:1789130706.697821:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789130706.697831:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23559:x1876038857780480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789130706.697925:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23559:x1876038857780480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 96us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130706.697932:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789130706.698238:0:23559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23559:1876038857780480:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789130706.698284:0:23559:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789130706.698331:0:23559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae8780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23559:1876038857788416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789130706.698363:0:23559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130706.698402:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3e61e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130706.698415:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857788416 00000100:00100000:1.0:1789130706.698419:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857788416 00000100:00100000:1.0:1789130706.698451:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789130706.698458:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23559:x1876038857788416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789130706.698556:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23559:x1876038857788416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130706.698563:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789130706.698587:0:23559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae8780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23559:1876038857788416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789130706.698959:0:23559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae8780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23559:1876038857788544:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789130706.698988:0:23559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130706.699108:0:23559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3e61e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130706.700497:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857788544 00000100:00100000:0.0:1789130706.700509:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857788544 00000100:00100000:0.0:1789130706.701780:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130706.701796:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23559:x1876038857788544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789130706.701948:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23559:x1876038857788544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 158us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130706.701957:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789130706.702167:0:23559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae8780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23559:1876038857788544:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789130706.702229:0:23559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130706.707215:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789130706.707322:0:23559:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:2.0:1789130706.707339:0:23559:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:1.0:1789130706.864906:0:24523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789130707.352763:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130707.801153:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1789130708.144985:0:24575:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130708.145237:0:24575:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789130708.378904:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789130709.187973:0:24626:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130709.188158:0:24626:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789130709.403728:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789130710.406155:0:24674:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb92fe300 20000000:00000080:1.0:1789130710.406179:0:24674:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9c8360f000 uarg=0000000000000000 20000000:01000000:1.0:1789130710.406225:0:24674:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789130710.406233:0:24674:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789130710.406238:0:24674:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789130710.406852:0:24675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:1.0:1789130710.407023:0:24674:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789130710.415559:0:24674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789130710.415591:0:24674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130710.416157:0:24674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050945e expref: 17 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130710.416167:0:24674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 17 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130710.416189:0:24674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130710.416234:0:24674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 17 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130710.416249:0:24674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 17 pid: 23508 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130710.416263:0:24674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1876038857788672:0@lo:104: 00000100:00100000:1.0:1789130710.416335:0:24674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130710.416410:0:24674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b050945e expref: 17 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130710.416419:0:24674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b050945e expref: 17 pid: 23510 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130710.416427:0:24674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82588000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1876038857788800:0@lo:104: 00000100:00100000:1.0:1789130710.416449:0:24674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130710.416475:0:24674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3e61a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130710.416544:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857788672 00000100:00100000:0.0:1789130710.416553:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857788672 00000100:00100000:0.0:1789130710.416592:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857788800 00000100:00100000:0.0:1789130710.416601:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857788800 00000100:00100000:0.0:1789130710.416660:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130710.416670:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:24674:x1876038857788672:12345-0@lo:104: 00010000:00010000:0.0:1789130710.416683:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130710.416747:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130710.416753:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:24674:x1876038857788672:12345-0@lo:104: Request processed in 86us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130710.416760:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130710.416780:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789130710.416786:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:24674:x1876038857788800:12345-0@lo:104: 00010000:00010000:0.0:1789130710.416793:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130710.416827:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130710.416832:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:24674:x1876038857788800:12345-0@lo:104: Request processed in 47us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130710.416838:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130710.417049:0:24674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1876038857788672:0@lo:104: 00000100:00100000:1.0:1789130710.417057:0:24674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82588000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1876038857788800:0@lo:104: 00010000:00010000:1.0:1789130710.417079:0:24674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417268:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130710.417276:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417283:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a93000 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130710.417288:0:23504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417296:0:23504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130710.417304:0:23504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130710.417310:0:23504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130710.417345:0:23504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417351:0:23504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130710.417372:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417379:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509561 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509568 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417391:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130710.417395:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417412:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982600 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130710.417415:0:23504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417421:0:23504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130710.417426:0:23504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130710.417431:0:23504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130710.417445:0:23504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417450:0:23504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130710.417456:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417463:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b050945e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509465 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417477:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130710.417479:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130710.417480:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130710.417493:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857788928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130710.417531:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130710.417562:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130710.417568:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857789056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130710.417597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130710.417662:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857788928 00000100:00100000:2.0:1789130710.417666:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857788928 00010000:00010000:2.0:1789130710.417688:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 18 pid: 23508 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130710.417780:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857789056 00000100:00100000:2.0:1789130710.417784:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857789056 00010000:00010000:2.0:1789130710.417800:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050945e expref: 19 pid: 23510 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130710.417816:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130710.417824:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:3644:x1876038857788928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130710.417835:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130710.417841:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 19 pid: 23508 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.417852:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 19 pid: 23508 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418032:0:23500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb4e6b200/0x76b2fec9b0509568 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b0509561 expref: 19 pid: 23508 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418047:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130710.418125:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:3644:x1876038857788928:12345-0@lo:103:ldlm_bl.0 Request processed in 302us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130710.418132:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130710.418149:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130710.418155:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:3644:x1876038857789056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130710.418174:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130710.418179:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050945e expref: 17 pid: 23510 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418188:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b050945e expref: 17 pid: 23510 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418198:0:23500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83a93800/0x76b2fec9b0509465 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b050945e expref: 17 pid: 23510 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418210:0:23500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418218:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418233:0:23500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418241:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418249:0:23500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418255:0:23500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418261:0:23500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983400 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130710.418265:0:23500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418283:0:23500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418297:0:23500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130710.418307:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130710.418333:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:3644:x1876038857789056:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130710.418340:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789130710.418762:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130710.418838:0:24674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130710.418847:0:24674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130710.418864:0:24674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83983400/0x76b2fec9b05095bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130710.421891:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857788928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130710.421923:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857789056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130710.425766:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130710.744742:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130695/real 1789130695] req@ffff9e9cb359fc00 x1876038857781760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130710 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130710.744779:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb359fc00 x1876038857781760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130710 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130710.744790:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130695/real 1789130695] req@ffff9e9cb359f0c0 x1876038857781504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130710 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130710.744801:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb359f0c0 x1876038857781504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130710 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789130710.744821:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa50000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130710.744849:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789130710.744866:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857781760:0@lo:8:kworker.0 00000100:00080000:0.0:1789130710.744873:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789130710.744878:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789130710.744881:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857781504:0@lo:8:kworker.0 00000100:00080000:3.0:1789130710.745034:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130710.745039:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789130710.745042:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa50000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130710.745047:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 714 00000100:00080000:3.0:1789130710.745053:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789130710.745059:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e9c9fa50000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130710.745081:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb34921c0 x1876038857789312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130710.745098:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130710.745101:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789130710.745103:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130710.745106:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 714 00000100:00080000:3.0:1789130710.745108:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789130710.745112:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9c9fa54800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130710.745123:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb3492940 x1876038857789440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130710.745153:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130710.745169:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130710.745172:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130710.745175:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789130710.745251:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876038857789568:0@lo:400:kworker.0 00000100:00100000:0.0:1789130710.745320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130710.745360:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130710.745367:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857789184:0@lo:400:kworker.0 00000100:00100000:0.0:1789130710.745393:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130710.745462:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857789568 00000100:00100000:3.0:1789130710.745470:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857789568 00000100:00100000:3.0:1789130710.745525:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130710.745534:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876038857789568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130710.745582:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876038857789568:12345-0@lo:400:kworker.0 Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130710.745589:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789130710.745778:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb3490b40 x1876038857789568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130710.745791:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876038857789568:0@lo:400:kworker.0 00000100:00100000:1.0:1789130710.746222:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857789696:0@lo:400:kworker.0 00000100:00100000:1.0:1789130710.746258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130710.746324:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130710.746331:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857789824:0@lo:400:kworker.0 00000100:00100000:1.0:1789130710.746355:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130710.746446:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857789312:0@lo:8:kworker.0 00000400:00000100:2.0:1789130710.746473:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857789312 offset 0 length 520: 4 00000100:00100000:2.0:1789130710.746497:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3492940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857789440:0@lo:8:kworker.0 00000400:00000100:2.0:1789130710.746512:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857789440 offset 0 length 520: 4 00000100:00100000:3.0:1789130710.746581:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857789824 00000100:00100000:3.0:1789130710.746585:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857789824 00000100:00100000:3.0:1789130710.746648:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130710.746655:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c82589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857789824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130710.746697:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c82589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857789824:12345-0@lo:400:kworker.0 Request processed in 42us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130710.746703:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130710.750437:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857789184 00000100:00100000:0.0:1789130710.750468:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857789184 00000100:00100000:0.0:1789130710.750520:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857789696 00000100:00100000:0.0:1789130710.750523:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857789696 00000100:00100000:0.0:1789130710.750544:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130710.750553:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857789184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130710.750680:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857789184:12345-0@lo:400:kworker.0 Request processed in 128us (5286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130710.750687:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130710.750704:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130710.750710:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c82588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857789696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130710.750741:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c82588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857789696:12345-0@lo:400:kworker.0 Request processed in 31us (4483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130710.750746:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130710.750788:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857789184:0@lo:400:kworker.0 00010000:00080000:1.0:1789130710.752518:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb3490000 x1876038857789824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130710.752536:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857789824:0@lo:400:kworker.0 00000100:00100000:1.0:1789130710.752549:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857789696:0@lo:400:kworker.0 00010000:00010000:0.0:1789130711.449487:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130711.768781:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130701/real 1789130701] req@ffff9e9cb359f480 x1876038857784064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130711 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130711.768821:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb359f480 x1876038857784064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130711 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130711.768832:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130701/real 1789130701] req@ffff9e9cb359e580 x1876038857783936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130711 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130711.768842:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb359e580 x1876038857783936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130711 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789130711.768864:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130711.768889:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789130711.768914:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857784064:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789130711.768920:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90d66800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130711.768926:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789130711.768929:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857783936:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789130711.769091:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130711.769097:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130711.769099:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130711.769103:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789130711.769123:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130711.769125:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789130711.769128:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c90d66800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789130711.769133:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 720 00000100:00080000:1.0:1789130711.769138:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789130711.769144:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e9c90d66800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1789130711.769162:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9c8258ad00 x1876038857790464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130711.769173:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789130711.769183:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789130711.769185:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789130711.769188:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 720 00000100:00080000:1.0:1789130711.769190:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789130711.769193:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e9b82105000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1789130711.769202:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9c8258b480 x1876038857790592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130711.769230:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c8258a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857790208:0@lo:400:kworker.0 00000100:00100000:1.0:1789130711.769297:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130711.769323:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130711.769328:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857790336:0@lo:400:kworker.0 00000100:00100000:1.0:1789130711.769363:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.769541:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c825883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857790080:0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.769569:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.769594:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789130711.769599:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857789952:0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.769647:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.769670:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c8258bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876038857790720:0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.769690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.769730:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857789952 00000100:00100000:2.0:1789130711.769736:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857789952 00000100:00100000:2.0:1789130711.769896:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789130711.769906:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:3643:x1876038857789952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.769960:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:3643:x1876038857789952:12345-0@lo:400:kworker.0 Request processed in 55us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.769967:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789130711.769999:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857790208 00000100:00100000:2.0:1789130711.770002:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857790208 00000100:00100000:2.0:1789130711.770027:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857790720 00000100:00100000:2.0:1789130711.770029:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857790720 00000100:00100000:2.0:1789130711.770041:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130711.770045:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857790208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.770083:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857790208:12345-0@lo:400:kworker.0 Request processed in 36us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.770099:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130711.770111:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130711.770116:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876038857790720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.770142:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876038857790720:12345-0@lo:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.770147:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789130711.770181:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9c8258a580 x1876038857790208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130711.770192:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c8258a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857790208:0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.770214:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857789952:0@lo:400:kworker.0 00010000:00080000:2.0:1789130711.770223:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9c8258bc00 x1876038857790720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130711.770230:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c8258bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876038857790720:0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.770245:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c8258ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857790464:0@lo:8:kworker.0 00000400:00000100:2.0:1789130711.770266:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857790464 offset 0 length 520: 4 00000100:00100000:2.0:1789130711.770278:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c8258b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857790592:0@lo:8:kworker.0 00000400:00000100:2.0:1789130711.770292:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876038857790592 offset 0 length 520: 4 00000100:00100000:1.0:1789130711.770414:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857790336 00000100:00100000:1.0:1789130711.770419:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857790336 00000100:00100000:1.0:1789130711.770442:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857790080 00000100:00100000:1.0:1789130711.770444:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857790080 00000100:00100000:1.0:1789130711.770459:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130711.770466:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857790336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130711.770506:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857790336:12345-0@lo:400:kworker.0 Request processed in 40us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130711.770512:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130711.770528:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130711.770534:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857790080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130711.770565:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857790080:12345-0@lo:400:kworker.0 Request processed in 32us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130711.770571:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130711.771402:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857790848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130711.771448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.771486:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c825883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857790080:0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.771512:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857790848 00000100:00100000:2.0:1789130711.771516:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857790848 00000100:00100000:2.0:1789130711.771554:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789130711.771561:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857790848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130711.771590:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789130711.771668:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857790848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.771675:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789130711.771708:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857790336:0@lo:400:kworker.0 00000100:00100000:2.0:1789130711.772260:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857790848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130711.777479:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857790976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130711.777559:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130711.777665:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857790976 00000100:00100000:0.0:1789130711.777673:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857790976 00000100:00100000:0.0:1789130711.777718:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130711.777728:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c825892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876038857790976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130711.777763:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789130711.785063:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c825892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876038857790976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7323us (7490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130711.785081:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130711.787937:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857790976:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1789130711.964066:0:23512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130711.964074:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b82102800 from 19 10000000:01000000:2.0:1789130711.964079:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130711.964126:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.964138:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.964150:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130711.964174:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.964236:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.964283:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c87dd6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789130711.964463:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857791104 00000100:00100000:3.0:1789130711.964471:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857791104 00000100:00100000:3.0:1789130711.964526:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130711.964536:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac763450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+16:23512:x1876038857791104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130711.964548:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130711.964561:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05095c3 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130711.964584:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 17 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130711.964602:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 17 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130711.964723:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb94000, rc 0) 00000100:00100000:3.0:1789130711.964772:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac763450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857791104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130711.964779:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789130711.966465:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130711.966492:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130711.966523:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130711.966599:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130711.966675:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130711.966734:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc122900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130711.967415:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857791232 00000100:00100000:2.0:1789130711.967423:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857791232 00000100:00100000:2.0:1789130711.967472:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789130711.967481:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857791232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.967642:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857791232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.967660:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789130711.967662:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130711.967706:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130711.968043:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130711.968072:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc122900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130711.968414:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857791360 00000100:00100000:2.0:1789130711.968420:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857791360 00000100:00100000:2.0:1789130711.968456:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789130711.968463:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857791360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.968558:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857791360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.968565:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789130711.968661:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789130711.969534:0:24728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789130711.970995:0:23512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789130711.971036:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130711.971049:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.971061:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130711.971073:0:23512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130711.971075:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9cb353d000 from 19 10000000:01000000:2.0:1789130711.971078:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130711.971112:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.971120:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.971129:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130711.971153:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.971228:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.971270:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83014e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130711.971293:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857791488 00000100:00100000:2.0:1789130711.971299:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857791488 00000100:00100000:2.0:1789130711.971343:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789130711.971351:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+17:23512:x1876038857791488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130711.971364:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130711.971377:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05095d1 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.971401:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 18 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.971412:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 18 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.971421:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a92800, rc 0) 00000100:00100000:2.0:1789130711.971459:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:23512:x1876038857791488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.971467:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789130711.971512:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130711.971526:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130711.971534:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130711.971586:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.971652:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.971665:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83014e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130711.971675:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857791616 00000100:00100000:2.0:1789130711.971678:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857791616 00000100:00100000:2.0:1789130711.971699:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789130711.971705:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:23512:x1876038857791616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.971814:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:23512:x1876038857791616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.971821:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789130711.971847:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.971873:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.971907:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130711.971918:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83014e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130711.971928:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857791744 00000100:00100000:2.0:1789130711.971931:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857791744 00000100:00100000:2.0:1789130711.971950:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130711.971954:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:23512:x1876038857791744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130711.972029:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:23512:x1876038857791744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130711.972035:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130711.972069:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857791744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789130711.972697:0:24729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789130711.973464:0:23512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789130711.973485:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130711.973496:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130711.973507:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789130712.290427:0:24253:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789130712.475048:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130713.497786:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130713.950012:0:24277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789130714.520851:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130715.554777:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130716.571863:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130716.889209:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130716.889235:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857791872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130716.889309:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789130716.889461:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130716.889466:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130716.889470:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130716.889473:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130716.889494:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130716.889497:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130716.889500:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130716.889503:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789130716.889528:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857792256:0@lo:400:kworker.0 00000100:00100000:3.0:1789130716.889578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130716.889601:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130716.889607:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857792384:0@lo:400:kworker.0 00000100:00100000:3.0:1789130716.889689:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130716.889719:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857792256 00000100:00100000:3.0:1789130716.889725:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857792256 00000100:00100000:3.0:1789130716.889768:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857792384 00000100:00100000:3.0:1789130716.889771:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857792384 00000100:00100000:3.0:1789130716.889786:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130716.889793:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3490780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857792256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130716.889843:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3490780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857792256:12345-0@lo:400:kworker.0 Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130716.889851:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130716.889866:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789130716.889872:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3492580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857792384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130716.889898:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3492580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857792384:12345-0@lo:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130716.889904:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789130716.889950:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb3491680 x1876038857792384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130716.889965:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857792384:0@lo:400:kworker.0 00010000:00080000:3.0:1789130716.889977:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb3490b40 x1876038857792256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130716.889985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857792256:0@lo:400:kworker.0 00000100:00100000:2.0:1789130716.890142:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857791872 00000100:00100000:2.0:1789130716.890153:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857791872 00000100:00100000:2.0:1789130716.890194:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789130716.890201:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c82588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857791872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130716.890230:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789130716.890270:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c82588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857791872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130716.890276:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789130716.890295:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857792128:0@lo:400:kworker.0 00000100:00100000:2.0:1789130716.890321:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130716.890348:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789130716.890354:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857792000:0@lo:400:kworker.0 00000100:00100000:2.0:1789130716.890382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130716.890403:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857792512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130716.890422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130716.890442:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857792000 00000100:00100000:2.0:1789130716.890446:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857792000 00000100:00100000:2.0:1789130716.890473:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789130716.890479:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:3643:x1876038857792000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130716.890510:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:3643:x1876038857792000:12345-0@lo:400:kworker.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130716.890517:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789130716.890553:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857792000:0@lo:400:kworker.0 00000100:00100000:2.0:1789130716.890586:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857792128 00000100:00100000:2.0:1789130716.890589:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857792128 00000100:00100000:2.0:1789130716.890604:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857792512 00000100:00100000:2.0:1789130716.890607:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857792512 00000100:00100000:2.0:1789130716.890727:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130716.890733:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857792128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130716.890768:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857792128:12345-0@lo:400:kworker.0 Request processed in 35us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130716.890774:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130716.890786:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130716.890792:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857792512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130716.890809:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789130716.890836:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857792512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130716.890843:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130716.890870:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857792512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130716.890879:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857792128:0@lo:400:kworker.0 00000100:00100000:3.0:1789130716.891961:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857791872:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789130717.044973:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789130717.594279:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789130718.483135:0:25022:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789130718.483140:0:25022:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789130718.483141:0:25022:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789130718.484781:0:25022:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9c870ca000 00000020:01000004:0.0:1789130718.484805:0:25022:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789130718.484821:0:25022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789130718.484856:0:25022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e9c8345b490) 00000020:00000080:0.0:1789130718.484876:0:25022:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789130718.554028:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789130718.555403:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789130718.555692:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789130718.556104:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789130718.559519:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789130718.560180:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789130718.560553:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1789130718.563581:0:25022:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789130718.563986:0:25022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789130718.564000:0:25022:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789130718.564012:0:25022:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x76b2fec9b05095e6 00000020:01000004:2.0:1789130718.564020:0:25022:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789130718.564043:0:25022:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789130718.564058:0:25022:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789130718.564064:0:25022:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789130718.564069:0:25022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789130718.564084:0:25022:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e9cb3beb490) 00000020:00000080:2.0:1789130718.564096:0:25022:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789130718.565233:0:25022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130718.565425:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789130718.565433:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789130718.576528:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789130718.576557:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789130718.577511:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789130718.577521:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789130718.584062:0:25022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130718.585853:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789130718.585871:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789130718.588851:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789130718.588867:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:3.0:1789130718.617483:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130718.620476:0:25022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789130718.620825:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789130718.620833:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789130718.622941:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789130718.622957:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789130718.624387:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789130718.624401:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789130718.633161:0:25022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789130718.634404:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789130718.634416:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789130718.636678:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789130718.636693:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789130718.689365:0:25022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130718.689604:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789130718.689611:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789130718.693971:0:25022:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789130718.693991:0:25022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789130718.694954:0:25022:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789130718.694984:0:25022:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789130718.694990:0:25022:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789130718.725076:0:25022:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789130718.725123:0:25022:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.110@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789130718.725129:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789130718.725131:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130718.725132:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130718.725133:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130718.725135:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130718.725136:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130718.725137:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130718.725139:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130718.725140:0:25022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130718.725144:0:25022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789130718.725146:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130718.725148:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130718.725149:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130718.725150:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130718.725151:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130718.725152:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130718.725153:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130718.725154:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130718.725155:0:25022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130718.725181:0:25022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789130718.725203:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857792640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789130718.725281:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.725392:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.725493:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857792640 00000100:00100000:0.0:1789130718.725500:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857792640 00000100:00100000:0.0:1789130718.725594:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130718.725604:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:25022:x1876038857792640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789130718.725677:0:23508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789130718.725681:0:23508:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789130718.725685:0:23508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789130718.726010:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:25022:x1876038857792640:12345-0@lo:253:mount.lustre.0 Request processed in 407us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.726019:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789130718.726114:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857792640:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789130718.726124:0:25022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789130718.726127:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130718.726128:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130718.726130:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130718.726137:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130718.726137:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130718.726139:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130718.726140:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130718.726141:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130718.726142:0:25022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789130718.726159:0:25022:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9c870ca000 from lustre-OST0000 10000000:01000000:3.0:1789130718.726185:0:25022:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789130718.726188:0:25022:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789130718.726197:0:25022:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e9b841b1a48 local copy 00010000:00010000:3.0:1789130718.726208:0:25022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130718.726288:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857792768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130718.726315:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.726703:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130718.726810:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857792768 00000100:00100000:2.0:1789130718.726816:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857792768 00000100:00100000:2.0:1789130718.726844:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789130718.726853:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:25022:x1876038857792768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130718.726925:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:25022:x1876038857792768:12345-0@lo:501:mount.lustre.0 Request processed in 73us (608us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130718.726931:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789130718.727096:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857792768:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789130718.727111:0:25022:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789130718.727129:0:25022:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789130718.727135:0:25022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130718.727143:0:25022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130718.727166:0:25022:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9c870ca000 10000000:01000000:3.0:1789130718.727170:0:25022:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789130718.727175:0:25022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789130718.727178:0:25022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130718.727183:0:25022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789130718.727186:0:25022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789130718.727218:0:25022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94200/0x76b2fec9b05095f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130718.727227:0:25022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94200/0x76b2fec9b05095f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130718.727235:0:25022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94200/0x76b2fec9b05095f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130718.727251:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857792896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130718.727277:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.727357:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.727417:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857792896 00000100:00100000:0.0:1789130718.727421:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857792896 00000100:00100000:0.0:1789130718.727443:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789130718.727449:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+18:25022:x1876038857792896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130718.727457:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130718.727469:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9cb4e6aa00/0x76b2fec9b05095fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05095f4 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.727493:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9cb4e6aa00/0x76b2fec9b05095fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05095f4 expref: 19 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.727503:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9cb4e6aa00/0x76b2fec9b05095fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05095f4 expref: 19 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.727511:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9cb4e6aa00, rc 0) 00000100:00100000:0.0:1789130718.727562:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857792896:12345-0@lo:101:mount.lustre.0 Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.727569:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789130718.727662:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857792896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130718.727673:0:25022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94200/0x76b2fec9b05095f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095fb expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130718.727683:0:25022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94200/0x76b2fec9b05095f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05095fb expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130718.728568:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1789130718.729220:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130718.731312:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789130718.731364:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789130718.731381:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789130718.731395:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789130718.731409:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789130718.731424:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789130718.731452:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789130718.731466:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789130718.731479:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1789130718.731501:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1789130718.731516:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1789130718.731528:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1789130718.731565:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1789130718.731571:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1789130718.731915:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130718.731998:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.732078:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c9fa2c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.732210:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857793024 00000100:00100000:0.0:1789130718.732218:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857793024 00000100:00100000:0.0:1789130718.732398:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789130718.732410:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130718.732584:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793024:12345-0@lo:501:mount.lustre.0 Request processed in 175us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.732592:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789130718.732710:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130718.732748:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130718.732793:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.732959:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c9fa2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130718.733006:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857793152 00000100:00100000:1.0:1789130718.733010:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857793152 00000100:00100000:1.0:1789130718.733035:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789130718.733042:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789130718.733937:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793152:12345-0@lo:503:mount.lustre.0 Request processed in 891us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130718.733947:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789130718.734125:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793152:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789130718.734815:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130718.734903:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130718.734961:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.735051:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c9fa2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130718.735087:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857793280 00000100:00100000:1.0:1789130718.735092:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857793280 00000100:00100000:1.0:1789130718.735176:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789130718.735193:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130718.735532:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793280:12345-0@lo:502:mount.lustre.0 Request processed in 340us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130718.735540:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789130718.735660:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130718.735828:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789130718.735854:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1789130718.735868:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1789130718.735882:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1789130718.735896:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1789130718.735911:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1789130718.735925:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1789130718.735953:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1789130718.735968:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1789130718.735991:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1789130718.736003:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1789130718.736016:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1789130718.736041:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130718.736075:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.736380:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c9fa2c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.736435:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857793408 00000100:00100000:0.0:1789130718.736440:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857793408 00000100:00100000:0.0:1789130718.736466:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789130718.736473:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130718.736590:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793408:12345-0@lo:502:mount.lustre.0 Request processed in 118us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.736598:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130718.736741:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130718.736786:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1789130718.736795:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789130718.737535:0:25039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789130718.737554:0:25039:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789130718.737570:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.737573:0:25039:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789130718.737581:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130718.737596:0:25039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e9cb4ef8000) 00000020:00000080:3.0:1789130718.737753:0:25039:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789130718.737762:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789130718.737831:0:25039:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9c870ca000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789130718.737840:0:25039:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789130718.737848:0:25039:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x76b2fec9b0509609 00010000:00010000:3.0:1789130718.758886:0:25039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789130718.759764:0:25039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1789130718.766518:0:25039:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:1.0:1789130718.770367:0:25039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789130718.770381:0:25039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130718.770407:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130718.770410:0:25039:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789130718.770413:0:25039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789130718.770417:0:25039:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1789130718.770418:0:25039:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789130718.770420:0:25039:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789130718.770421:0:25039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789130718.770424:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130718.770425:0:25039:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789130718.770428:0:25039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130718.770431:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130718.770432:0:25039:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789130718.770435:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789130718.770437:0:25039:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789130718.770440:0:25039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130718.770442:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130718.770444:0:25039:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789130718.770446:0:25039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130718.770449:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130718.770450:0:25039:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789130718.770453:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789130718.770487:0:25039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130718.770490:0:25039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130718.770492:0:25039:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789130718.770496:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1789130718.771160:0:25022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789130718.771193:0:25022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789130718.771220:0:25022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94200/0x76b2fec9b05095f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095fb expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.771232:0:25022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94200/0x76b2fec9b05095f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05095fb expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130718.771254:0:25022:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9c870ca000 from 1 10000000:01000000:2.0:1789130718.771256:0:25022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130718.771298:0:25022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.771305:0:25022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.771315:0:25022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130718.771343:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789130718.771416:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130718.771456:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.773584:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857793536 00000100:00100000:0.0:1789130718.773604:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857793536 00000100:00100000:0.0:1789130718.773823:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789130718.773834:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:25022:x1876038857793536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789130718.773852:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130718.773871:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b0509610 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.773900:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 20 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.773925:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 20 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.773935:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9cb4e6b400, rc 0) 00000100:00100000:0.0:1789130718.774193:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857793536:12345-0@lo:101:mount.lustre.0 Request processed in 359us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.774201:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789130718.774354:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130718.774378:0:25022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.774388:0:25022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130718.778524:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:2.0:1789130718.778867:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130718.779058:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789130718.779083:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789130718.779096:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789130718.779110:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789130718.779123:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789130718.779146:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789130718.779158:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789130718.779171:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:2.0:1789130718.779184:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:2.0:1789130718.779197:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:2.0:1789130718.779210:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:2.0:1789130718.779234:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:2.0:1789130718.779248:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:2.0:1789130718.779260:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:2.0:1789130718.779272:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:2.0:1789130718.779284:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:2.0:1789130718.779296:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:2.0:1789130718.779311:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:2.0:1789130718.779316:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:2.0:1789130718.779404:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130718.779473:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130718.779516:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c83f160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.780358:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857793664 00000100:00100000:0.0:1789130718.780368:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857793664 00000100:00100000:0.0:1789130718.780428:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789130718.780437:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857793664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789130718.780594:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857793664:12345-0@lo:501:mount.lustre.0 Request processed in 158us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.780603:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789130718.780835:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130718.780884:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130718.780937:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.780977:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7840 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.781753:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857793792 00000100:00100000:0.0:1789130718.781760:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857793792 00000100:00100000:0.0:1789130718.782044:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789130718.782054:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857793792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130718.782190:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857793792:12345-0@lo:503:mount.lustre.0 Request processed in 138us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.782196:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789130718.782272:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793792:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789130718.782804:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789130718.782886:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130718.782933:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130718.786927:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c83f160c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130718.787325:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857793920 00000100:00100000:1.0:1789130718.787336:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857793920 00000100:00100000:1.0:1789130718.787406:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789130718.787415:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857793920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130718.787590:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857793920:12345-0@lo:502:mount.lustre.0 Request processed in 176us (4657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130718.787599:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130718.788324:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857793920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789130718.788604:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789130718.789312:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789130718.789328:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789130718.789341:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789130718.789353:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789130718.789364:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789130718.789392:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789130718.789419:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:2.0:1789130718.789432:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:2.0:1789130718.789445:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:2.0:1789130718.789457:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:2.0:1789130718.789470:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:2.0:1789130718.789481:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:2.0:1789130718.789493:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:2.0:1789130718.789505:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:2.0:1789130718.789517:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:2.0:1789130718.789529:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:2.0:1789130718.789587:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130718.790136:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130718.790210:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130718.790246:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857794048 00000100:00100000:1.0:1789130718.790254:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857794048 00000100:00100000:1.0:1789130718.790335:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789130718.790344:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857794048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130718.790468:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857794048:12345-0@lo:502:mount.lustre.0 Request processed in 124us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130718.790476:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789130718.790562:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130718.790685:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:3.0:1789130718.790696:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789130718.791797:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130718.791809:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791811:0:25043:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789130718.791819:0:25043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9c870ca000 00000020:00000080:3.0:1789130718.791822:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130718.791829:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130718.791832:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791834:0:25043:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789130718.791836:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130718.791839:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791840:0:25043:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789130718.791844:0:25043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9c870ca000 00000020:00000080:3.0:1789130718.791846:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130718.791901:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130718.791905:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791907:0:25043:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789130718.791909:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130718.791911:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791913:0:25043:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789130718.791916:0:25043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9c870ca000 00000020:00000080:3.0:1789130718.791918:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130718.791935:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130718.791938:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791939:0:25043:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789130718.791942:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130718.791944:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791945:0:25043:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789130718.791949:0:25043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9c870ca000 00000020:00000080:3.0:1789130718.791962:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130718.791978:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130718.791987:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791988:0:25043:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789130718.791992:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130718.791994:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.791996:0:25043:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789130718.791999:0:25043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9c870ca000 00000020:00000080:3.0:1789130718.792001:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130718.792018:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130718.792021:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.792022:0:25043:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789130718.792024:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130718.792027:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.792028:0:25043:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789130718.792031:0:25043:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9c870ca000 00000020:00000080:3.0:1789130718.792032:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130718.792051:0:25043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130718.792054:0:25043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130718.792055:0:25043:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789130718.792058:0:25043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:2.0:1789130718.797876:0:25022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789130718.797935:0:25022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130718.797957:0:25022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.797971:0:25022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130718.798035:0:25022:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789130718.798038:0:25022:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9c870ca000 10000000:01000000:2.0:1789130718.798041:0:25022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9c870ca000 10000000:01000000:2.0:1789130718.798046:0:25022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789130718.798051:0:25022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9c870ca000 from 1 10000000:01000000:2.0:1789130718.798054:0:25022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789130718.798090:0:25022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93e00/0x76b2fec9b050961e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.798099:0:25022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93e00/0x76b2fec9b050961e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.798121:0:25022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93e00/0x76b2fec9b050961e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130718.798150:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789130718.798226:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130718.798260:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130718.799279:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857794176 00000100:00100000:3.0:1789130718.799291:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857794176 00000100:00100000:3.0:1789130718.799353:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130718.799364:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:25022:x1876038857794176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130718.799380:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130718.799395:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb95600/0x76b2fec9b0509625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050961e expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130718.799422:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb95600/0x76b2fec9b0509625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050961e expref: 21 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130718.799434:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb95600/0x76b2fec9b0509625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050961e expref: 21 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130718.799452:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb95600, rc 0) 00000100:00100000:3.0:1789130718.799516:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794176:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130718.799523:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789130718.801166:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789130718.801196:0:25022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93e00/0x76b2fec9b050961e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509625 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.801207:0:25022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93e00/0x76b2fec9b050961e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509625 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130718.802389:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1789130718.803790:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130718.803984:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789130718.804024:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789130718.804039:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789130718.804053:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789130718.804067:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789130718.804078:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789130718.804090:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789130718.804102:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789130718.804115:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789130718.804127:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789130718.804139:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789130718.804151:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789130718.804162:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789130718.804176:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789130718.804200:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789130718.804214:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789130718.804226:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789130718.804248:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789130718.804262:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789130718.804274:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789130718.804285:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789130718.804297:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789130718.804309:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789130718.804321:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789130718.804333:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1789130718.804345:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1789130718.804357:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1789130718.804369:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1789130718.804380:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1789130718.804392:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1789130718.804404:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1789130718.804416:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1789130718.804428:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1789130718.804453:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1789130718.804467:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1789130718.804480:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1789130718.804493:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1789130718.804505:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1789130718.804516:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1789130718.804528:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1789130718.804552:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1789130718.804570:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1789130718.804584:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1789130718.804596:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1789130718.804609:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1789130718.805876:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1789130718.805893:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1789130718.805915:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1789130718.806118:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1789130718.806137:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1789130718.806152:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1789130718.806157:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1789130718.806264:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130718.806327:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130718.806411:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3eb7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789130718.815811:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857794304 00000100:00100000:3.0:1789130718.815826:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857794304 00000100:00100000:3.0:1789130718.815887:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789130718.815897:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130718.816111:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794304:12345-0@lo:501:mount.lustre.0 Request processed in 214us (9782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130718.816119:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789130718.816710:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130718.816764:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130718.816817:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.816857:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc362480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.817068:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857794432 00000100:00100000:0.0:1789130718.817073:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857794432 00000100:00100000:0.0:1789130718.817117:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789130718.817133:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130718.817223:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794432:12345-0@lo:503:mount.lustre.0 Request processed in 92us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.817230:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789130718.818810:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794432:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789130718.819330:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130718.819422:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130718.819495:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.819532:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc362480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130718.819590:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857794560 00000100:00100000:3.0:1789130718.819595:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857794560 00000100:00100000:3.0:1789130718.819730:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789130718.819740:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130718.819852:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794560:12345-0@lo:502:mount.lustre.0 Request processed in 113us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130718.819860:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789130718.819907:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130718.820072:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789130718.820095:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789130718.820109:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789130718.820121:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789130718.820134:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789130718.820146:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789130718.820160:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789130718.820172:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789130718.820185:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789130718.820198:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789130718.820211:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789130718.820224:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789130718.820237:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789130718.820250:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789130718.820263:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789130718.820275:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789130718.820288:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789130718.820300:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789130718.820326:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789130718.820340:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789130718.820352:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789130718.820364:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789130718.820377:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789130718.820390:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789130718.820405:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1789130718.820418:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1789130718.820439:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1789130718.820452:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1789130718.820464:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1789130718.820476:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1789130718.820488:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1789130718.820501:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1789130718.820514:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1789130718.820526:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1789130718.820564:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1789130718.820580:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1789130718.820593:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1789130718.820607:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1789130718.821775:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1789130718.821798:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1789130718.821812:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1789130718.821826:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1789130718.821839:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1789130718.821852:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1789130718.822183:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1789130718.822197:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1789130718.822209:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1789130718.822221:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1789130718.822275:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130718.822351:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.822393:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc362480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130718.822419:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857794688 00000100:00100000:3.0:1789130718.822425:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857794688 00000100:00100000:3.0:1789130718.822474:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130718.822481:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130718.822603:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794688:12345-0@lo:502:mount.lustre.0 Request processed in 121us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130718.822713:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130718.822766:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130718.822929:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1789130718.822949:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1789130718.822970:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130718.823001:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.823021:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc362480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130718.823033:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857794816 00000100:00100000:3.0:1789130718.823037:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857794816 00000100:00100000:3.0:1789130718.823053:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130718.823058:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130718.823119:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857794816:12345-0@lo:502:mount.lustre.0 Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130718.823125:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130718.823158:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857794816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130718.823190:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789130718.823197:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789130718.826904:0:25048:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789130718.826921:0:25048:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e9cb4efced8) 00000020:00000080:3.0:1789130718.826947:0:25048:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1789130718.827038:0:25048:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9c870ca000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789130718.827043:0:25048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9c870ca000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789130718.827045:0:25048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9c870ca000 3 00010000:00080000:3.0:1789130718.827081:0:25048:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9cbff39800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.110@tcp at head 00010000:00010000:2.0:1789130718.829068:0:25048:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789130718.829277:0:25048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789130718.829323:0:25048:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789130718.829336:0:25048:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x76b2fec9b0509633 00000100:00080000:2.0:1789130718.829348:0:25048:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130718.829355:0:25048:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e9cbff39800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130718.829393:0:25048:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2d2c0 x1876038857794944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130718.829415:0:25048:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1789130718.830738:0:25048:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789130718.830755:0:25048:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e9cb3be9a48) 00000020:00000080:2.0:1789130718.830775:0:25048:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789130718.830845:0:25048:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9c870ca000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789130718.830850:0:25048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9c870ca000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789130718.830853:0:25048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9c870ca000 3 00010000:00080000:2.0:1789130718.830880:0:25048:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9cada52800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.110@tcp at head 00000100:00080000:3.0:1789130718.832806:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130718.832813:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130718.832822:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130718.832825:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130718.832856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130718.832859:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130718.832861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130718.832864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789130718.832909:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857795200:0@lo:400:kworker.0 00000100:00100000:3.0:1789130718.832974:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.833011:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130718.833017:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857795328:0@lo:400:kworker.0 00000100:00100000:3.0:1789130718.833042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.833076:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857795200 00000100:00100000:3.0:1789130718.833082:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857795200 00000100:00100000:3.0:1789130718.833138:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789130718.833147:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857795200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130718.833200:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857795200:12345-0@lo:400:kworker.0 Request processed in 55us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130718.833207:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789130718.833249:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb34930c0 x1876038857795200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130718.833263:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857795200:0@lo:400:kworker.0 00000100:00100000:2.0:1789130718.834746:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857795072:0@lo:400:kworker.0 00000100:00100000:2.0:1789130718.834794:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130718.834822:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130718.834828:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876038857795456:0@lo:400:kworker.0 00000100:00100000:2.0:1789130718.834860:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130718.834907:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857795328 00000100:00100000:2.0:1789130718.834913:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857795328 00000100:00100000:2.0:1789130718.834939:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857795072 00000100:00100000:2.0:1789130718.834942:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857795072 00000100:00100000:2.0:1789130718.834956:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130718.834963:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84922940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857795328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130718.835013:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84922940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857795328:12345-0@lo:400:kworker.0 Request processed in 50us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130718.835019:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130718.835034:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130718.835040:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857795072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130718.835069:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857795072:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130718.835075:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130718.835111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857795328:0@lo:400:kworker.0 00000100:00100000:2.0:1789130718.835139:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857795072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130718.837238:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876038857794944:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789130718.837302:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130718.837389:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857795456 00000100:00100000:0.0:1789130718.837395:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857795456 00000100:00100000:0.0:1789130718.837430:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857794944 00000100:00100000:0.0:1789130718.837433:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857794944 00000100:00100000:0.0:1789130718.837446:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130718.837454:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876038857795456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130718.837503:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876038857795456:12345-0@lo:400:kworker.0 Request processed in 50us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.837510:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130718.837525:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130718.837529:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876038857794944:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789130718.837561:0:23517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 737 last 0 00000020:00000080:0.0:1789130718.837596:0:23517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x76b2fec9b0509641 00010000:00010000:2.0:1789130718.838355:0:25048:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000004:00100000:0.0:1789130718.838434:0:23517:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789130718.838472:0:23517:0:(import.c:65:import_set_state_nolock()) ffff9e9b848ae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130718.838526:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876038857794944:12345-0@lo:38:llog_process_th.0 Request processed in 993us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.838534:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789130718.838592:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb34912c0 x1876038857795456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130718.838646:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876038857795456:0@lo:400:kworker.0 00010000:00080000:0.0:1789130718.838681:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb4e2d2c0 x1876038857794944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130718.838690:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130718.838696:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789130718.838703:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789130718.838707:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789130718.838710:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cbff39800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789130718.838715:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876038857794944:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1789130718.839881:0:25048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789130718.839928:0:25048:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789130718.839941:0:25048:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x76b2fec9b0509648 00000100:00080000:2.0:1789130718.839951:0:25048:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130718.839957:0:25048:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e9cada52800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130718.839991:0:25048:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4e2d2c0 x1876038857795584/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130718.840020:0:25048:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789130718.840053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130718.840058:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130718.840060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130718.840063:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130718.840068:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130718.840071:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789130718.840074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130718.840077:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789130718.841756:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876038857795584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789130718.841841:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130718.841931:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857795584 00000100:00100000:0.0:1789130718.841939:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857795584 00000100:00100000:0.0:1789130718.841979:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789130718.841987:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876038857795584:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789130718.842018:0:23515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 737 last 0 00000020:00000080:0.0:1789130718.842056:0:23515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x76b2fec9b050964f 00000004:00100000:0.0:1789130718.842074:0:23515:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789130718.842109:0:23515:0:(import.c:65:import_set_state_nolock()) ffff9e9b848ae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130718.842157:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876038857795584:12345-0@lo:38:llog_process_th.0 Request processed in 169us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.842164:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789130718.842206:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e9cb4e2d2c0 x1876038857795584/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130718.842229:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130718.842238:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789130718.842247:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789130718.842253:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789130718.842256:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cada52800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789130718.842262:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876038857795584:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789130718.844155:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789130718.845796:0:25022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789130718.845844:0:25022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789130718.854502:0:25022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93e00/0x76b2fec9b050961e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509625 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130718.854528:0:25022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93e00/0x76b2fec9b050961e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509625 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789130718.854628:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789130718.854641:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130718.854642:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130718.854644:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130718.854645:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130718.854647:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130718.854648:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130718.854650:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130718.854652:0:25022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130718.854656:0:25022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789130718.854658:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130718.854659:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130718.854660:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130718.854662:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130718.854663:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130718.854664:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130718.854665:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130718.854666:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130718.854667:0:25022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130718.854695:0:25022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789130718.854719:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857795712:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789130718.854797:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130718.854842:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc362f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130718.854883:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857795712 00000100:00100000:3.0:1789130718.854890:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857795712 00000100:00100000:3.0:1789130718.854936:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789130718.854944:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857795712:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789130718.854973:0:23510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789130718.854988:0:23510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789130718.864157:0:23510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789130718.864174:0:23510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789130718.864499:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25022:x1876038857795712:12345-0@lo:253:mount.lustre.0 Request processed in 9550us (9697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130718.864512:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789130718.864645:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25022:1876038857795712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789130718.864660:0:25022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789130718.864664:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130718.864666:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130718.864667:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130718.864668:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130718.864670:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130718.864671:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130718.864672:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130718.864674:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130718.864675:0:25022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789130718.864690:0:25022:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789130718.869996:0:23531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789130718.870003:0:23531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789130718.870028:0:23531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.870049:0:23531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 20 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.870057:0:23531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 20 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.870065:0:23531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.870110:0:23531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 20 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.870127:0:23531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 20 pid: 23508 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130718.870142:0:23531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857795840:0@lo:104: 00000100:00100000:0.0:1789130718.870211:0:23531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130718.870279:0:23531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 20 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.870288:0:23531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 20 pid: 23509 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130718.870297:0:23531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857795968:0@lo:104: 00000100:00100000:0.0:1789130718.870322:0:23531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130718.870340:0:23531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8762b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130718.870377:0:23498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789130718.870394:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857795840 00000100:00100000:0.0:1789130718.870401:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857795840 00000100:00100000:0.0:1789130718.870437:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857795968 00000100:00100000:0.0:1789130718.870441:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857795968 00000100:00100000:0.0:1789130718.870456:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130718.870464:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:23531:x1876038857795840:12345-0@lo:104: 00010000:00010000:0.0:1789130718.870477:0:23498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.870528:0:23498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130718.870533:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:23531:x1876038857795840:12345-0@lo:104: Request processed in 71us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.870551:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130718.870569:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130718.870575:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:23531:x1876038857795968:12345-0@lo:104: 00010000:00010000:0.0:1789130718.870582:0:23498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.871700:0:23498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130718.871721:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:23531:x1876038857795968:12345-0@lo:104: Request processed in 1142us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.871729:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130718.871818:0:23531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857795840:0@lo:104: 00000100:00100000:0.0:1789130718.871829:0:23531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857795968:0@lo:104: 00010000:00010000:0.0:1789130718.871850:0:23531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.871871:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130718.871877:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.871885:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6ba00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:0.0:1789130718.871889:0:23503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.871899:0:23503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130718.871906:0:23503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130718.871913:0:23503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130718.871965:0:23503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.871973:0:23503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130718.871996:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.872014:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6ba00/0x76b2fec9b05095a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095ae expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.872030:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130718.872034:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.872040:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6a200 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:0.0:1789130718.872044:0:23503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.872050:0:23503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130718.872057:0:23503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130718.872063:0:23503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130718.872076:0:23503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.872082:0:23503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130718.872098:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.872106:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b0509599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095a0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1789130718.872785:0:25022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:0.0:1789130718.874289:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130718.874297:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130718.874299:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130718.874307:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130718.874335:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857796096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130718.874404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130718.874470:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857796224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130718.874495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130718.874536:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857796096 00000100:00100000:0.0:1789130718.874552:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857796096 00010000:00010000:0.0:1789130718.874581:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 21 pid: 23508 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130718.874607:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857796224 00000100:00100000:0.0:1789130718.874628:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857796224 00000100:00100000:2.0:1789130718.876139:0:23501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130718.876153:0:23501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:3643:x1876038857796096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130718.876171:0:23501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130718.876181:0:23501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 22 pid: 23508 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.876252:0:23501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 22 pid: 23508 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.876274:0:23501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05095ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b05095a7 expref: 22 pid: 23508 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130718.876286:0:23501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130718.876346:0:23501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3643:x1876038857796096:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130718.876354:0:23501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789130718.876851:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 20 pid: 23509 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130718.876885:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130718.876893:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac761450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:3644:x1876038857796224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130718.876902:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130718.876906:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 20 pid: 23509 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.876916:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 20 pid: 23509 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.876927:0:23502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83982800/0x76b2fec9b05095a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b0509599 expref: 20 pid: 23509 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.876938:0:23502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878605:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789130718.878645:0:23502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008642639s 00010000:00010000:0.0:1789130718.878652:0:23502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878659:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878668:0:23502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878677:0:23502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878684:0:23502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6bc00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130718.878689:0:23502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878697:0:23502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878726:0:23502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878738:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130718.878813:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac761450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:3644:x1876038857796224:12345-0@lo:103:ldlm_bl.0 Request processed in 1918us (4312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130718.878823:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130718.878924:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857796096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130718.878958:0:23531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878966:0:23531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130718.878972:0:23531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb4e6bc00/0x76b2fec9b0509656 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130718.879003:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857796224:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1789130718.895315:0:25022:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789130718.895325:0:25022:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789130718.895366:0:25022:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789130718.895409:0:25022:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789130718.895435:0:25022:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789130718.895461:0:25022:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789130718.897332:0:25022:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130718.897535:0:25022:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789130719.641219:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789130720.025146:0:23512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789130720.025154:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b82102800 from 13 10000000:01000000:0.0:1789130720.025160:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130720.025213:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130720.025225:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130720.025237:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130720.025275:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857796352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130720.025341:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130720.025380:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8762b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130720.025803:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857796352 00000100:00100000:3.0:1789130720.025810:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857796352 00000100:00100000:3.0:1789130720.025877:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789130720.025887:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+19:23512:x1876038857796352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130720.025903:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130720.025920:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050965d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130720.027070:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050965d expref: 20 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130720.027086:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050965d expref: 20 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130720.027098:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb95a00, rc 0) 00000100:00100000:3.0:1789130720.027190:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:23512:x1876038857796352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1304us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130720.027200:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789130720.027236:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857796352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130720.027257:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130720.027267:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130720.027334:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857796480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789130720.027372:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130720.028759:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8762b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130720.028786:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857796480 00000100:00100000:0.0:1789130720.028795:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857796480 00000100:00100000:0.0:1789130720.028846:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789130720.028855:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:23512:x1876038857796480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789130720.028879:0:23510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789130720.028897:0:23510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789130720.028900:0:23510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789130720.029214:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:23512:x1876038857796480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 359us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130720.029222:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789130720.029270:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857796480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789130720.029338:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789130720.029352:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130720.029362:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130720.029372:0:23512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789130720.029374:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9cb353d000 from 13 10000000:01000000:0.0:1789130720.029377:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130720.029406:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130720.029412:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130720.029420:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130720.029441:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857796608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130720.029475:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130720.029510:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8762b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789130720.029562:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857796608 00000100:00100000:2.0:1789130720.029567:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857796608 00000100:00100000:2.0:1789130720.029599:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789130720.029607:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:23512:x1876038857796608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130720.029639:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130720.029652:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050966b expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130720.029675:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050966b expref: 21 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130720.029686:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050966b expref: 21 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130720.029693:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83a93400, rc 0) 00000100:00100000:2.0:1789130720.029728:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857796608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130720.029734:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789130720.029769:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857796608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130720.029785:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130720.029794:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130720.029839:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857796736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789130720.029870:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130720.029883:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130720.029900:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857796736 00000100:00100000:2.0:1789130720.029904:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857796736 00000100:00100000:2.0:1789130720.029923:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789130720.029928:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857796736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789130720.029939:0:23510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789130720.029952:0:23510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789130720.029955:0:23510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789130720.030040:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857796736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130720.030057:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789130720.030086:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857796736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789130720.030250:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789130720.030256:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130720.030263:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1789130720.213561:0:25105:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789130720.213956:0:25105:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789130720.664915:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130721.688920:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130722.009295:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130722.009541:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857796864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130722.009641:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130722.009750:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857796864 00000100:00100000:3.0:1789130722.009765:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857796864 00000100:00100000:3.0:1789130722.009825:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789130722.009834:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857796864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130722.009871:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789130722.009923:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857796864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130722.009931:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789130722.010177:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857796864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130722.012594:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130722.012695:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c8258b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857796992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130722.012779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130722.013145:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857796992 00000100:00100000:1.0:1789130722.013155:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857796992 00000100:00100000:1.0:1789130722.013216:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130722.013228:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857796992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130722.013261:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789130722.013502:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857796992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 276us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130722.013523:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130722.013581:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c8258b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857796992:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789130722.713915:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130723.161411:0:24277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789130723.737011:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130724.059459:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857797120:0@lo:400:kworker.0 00000100:00100000:1.0:1789130724.059551:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789130724.059971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130724.059976:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130724.059979:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130724.059981:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789130724.060052:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857797120 00000100:00100000:2.0:1789130724.060062:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857797120 00000100:00100000:2.0:1789130724.060119:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789130724.060130:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3643:x1876038857797120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.060211:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857797248:0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.060247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130724.060288:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130724.060294:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857797376:0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.060320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130724.060352:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857797248 00000100:00100000:0.0:1789130724.060357:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857797248 00000100:00100000:0.0:1789130724.060385:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130724.060392:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857797248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.060432:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857797248:12345-0@lo:400:kworker.0 Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130724.060438:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130724.060469:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857797376 00000100:00100000:0.0:1789130724.060472:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857797376 00000100:00100000:0.0:1789130724.060507:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130724.060514:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857797376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.060545:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857797376:12345-0@lo:400:kworker.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130724.060552:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130724.060575:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b849212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857797504:0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.060634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130724.060660:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857797504 00000100:00100000:0.0:1789130724.060663:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857797504 00000100:00100000:0.0:1789130724.060698:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130724.060704:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857797504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.060737:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857797504:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130724.060743:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130724.060791:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b849212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857797504:0@lo:400:kworker.0 00010000:00080000:0.0:1789130724.060836:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b84922580 x1876038857797376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130724.060847:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857797376:0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.060856:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857797248:0@lo:400:kworker.0 00000100:00080000:3.0:1789130724.062846:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130724.062855:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130724.062858:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130724.062862:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789130724.062941:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130724.063026:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3643:x1876038857797120:12345-0@lo:400:kworker.0 Request processed in 2892us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130724.063054:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789130724.064031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876038857797888:0@lo:400:kworker.0 00000100:00100000:3.0:1789130724.064107:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130724.064146:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130724.064152:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876038857797760:0@lo:400:kworker.0 00000100:00100000:3.0:1789130724.064179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130724.065978:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857797888 00000100:00100000:2.0:1789130724.065993:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857797888 00000100:00100000:2.0:1789130724.066069:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857797760 00000100:00100000:2.0:1789130724.066073:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857797760 00000100:00100000:2.0:1789130724.066095:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789130724.066106:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84920b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876038857797888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130724.066202:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84920b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876038857797888:12345-0@lo:400:kworker.0 Request processed in 97us (2094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130724.066210:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789130724.066227:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789130724.066233:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b849203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876038857797760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130724.066263:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b849203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876038857797760:12345-0@lo:400:kworker.0 Request processed in 30us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130724.066269:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789130724.066297:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130724.066301:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789130724.066338:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b84921e00 x1876038857797760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130724.066354:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876038857797760:0@lo:400:kworker.0 00010000:00080000:2.0:1789130724.066369:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b84922d00 x1876038857797888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130724.066377:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876038857797888:0@lo:400:kworker.0 00000100:00100000:1.0:1789130724.066911:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857797120:0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.067173:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857797632:0@lo:400:kworker.0 00000100:00100000:0.0:1789130724.067223:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130724.067853:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857797632 00000100:00100000:2.0:1789130724.067860:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857797632 00000100:00100000:2.0:1789130724.067909:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789130724.067917:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857797632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130724.067984:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857797632:12345-0@lo:400:kworker.0 Request processed in 67us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130724.067991:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789130724.068140:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b84923c00 x1876038857797632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130724.068155:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857797632:0@lo:400:kworker.0 00010000:00010000:1.0:1789130724.760755:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130725.785031:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130726.043357:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130711/real 1789130711] req@ffff9e9c8258ad00 x1876038857790464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130726 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130726.043393:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9c8258ad00 x1876038857790464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130726 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130726.043403:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130711/real 1789130711] req@ffff9e9c8258b480 x1876038857790592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130726 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130726.043415:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9c8258b480 x1876038857790592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130726 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789130726.043437:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90d66800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130726.043465:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789130726.043469:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c8258ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857790464:0@lo:8:kworker.0 00000100:00080000:1.0:1789130726.043484:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130726.043490:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789130726.043493:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c8258b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857790592:0@lo:8:kworker.0 00000100:00080000:3.0:1789130726.043672:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130726.043678:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130726.043686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130726.043689:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789130726.043721:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130726.043724:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789130726.043727:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9c90d66800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130726.043732:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 730 00000100:00080000:3.0:1789130726.043737:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789130726.043743:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e9c90d66800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130726.043773:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b84922d00 x1876038857798528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130726.043786:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789130726.043789:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789130726.043791:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130726.043794:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 730 00000100:00080000:3.0:1789130726.043796:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789130726.043800:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e9b82105000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130726.043811:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b84921e00 x1876038857798656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130726.043849:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857798272:0@lo:400:kworker.0 00000100:00100000:3.0:1789130726.044097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.044132:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b849212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857799040:0@lo:400:kworker.0 00000100:00100000:3.0:1789130726.044156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.044189:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130726.044196:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857798400:0@lo:400:kworker.0 00000100:00100000:3.0:1789130726.044231:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.044267:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857798272 00000100:00100000:3.0:1789130726.044275:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857798272 00000100:00100000:3.0:1789130726.044318:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857799040 00000100:00100000:3.0:1789130726.044321:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857799040 00000100:00100000:3.0:1789130726.044350:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130726.044358:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857798272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130726.044410:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857798272:12345-0@lo:400:kworker.0 Request processed in 52us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130726.044419:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130726.044436:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130726.044442:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84923840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857799040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130726.044469:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84923840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857799040:12345-0@lo:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130726.044490:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130726.044513:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857798400 00000100:00100000:3.0:1789130726.044516:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857798400 00000100:00100000:3.0:1789130726.044541:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130726.044548:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3490b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857798400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130726.044582:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3490b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857798400:12345-0@lo:400:kworker.0 Request processed in 35us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130726.044587:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789130726.044606:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130726.044645:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857798528:0@lo:8:kworker.0 00000100:00100000:3.0:1789130726.044678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.044705:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857798656:0@lo:8:kworker.0 00000100:00100000:3.0:1789130726.044741:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.044808:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857798400:0@lo:400:kworker.0 00010000:00080000:3.0:1789130726.044820:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b84923c00 x1876038857798272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130726.044830:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857798272:0@lo:400:kworker.0 00010000:00080000:3.0:1789130726.044839:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b849212c0 x1876038857799040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130726.044847:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b849212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857799040:0@lo:400:kworker.0 00000100:00100000:1.0:1789130726.045265:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b849230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3642:1876038857798016:0@lo:400:kworker.0 00000100:00100000:1.0:1789130726.045303:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130726.045331:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857798784:0@lo:400:kworker.0 00000100:00100000:1.0:1789130726.045354:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130726.045375:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789130726.045381:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857798144:0@lo:400:kworker.0 00000100:00100000:1.0:1789130726.045403:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130726.045419:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876038857798912:0@lo:400:kworker.0 00000100:00100000:1.0:1789130726.045440:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130726.045470:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857798528 00000100:00100000:1.0:1789130726.045486:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857798528 00000100:00100000:1.0:1789130726.045505:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857798656 00000100:00100000:1.0:1789130726.045507:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857798656 00000100:00100000:1.0:1789130726.045516:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130726.045521:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876038857798528:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789130726.045547:0:25026:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 744 last 0 00000020:00000080:1.0:1789130726.045577:0:25026:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76b2fec9b0509679 00002000:00100000:1.0:1789130726.045592:0:25026:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e9b84808000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789130726.045596:0:25026:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789130726.045599:0:25026:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789130726.045828:0:25026:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789130726.045853:0:25026:0:(import.c:65:import_set_state_nolock()) ffff9e9b84809000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130726.047064:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876038857798528:12345-0@lo:8:kworker.0 Request processed in 1534us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130726.047076:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130726.047106:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130726.047128:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876038857798656:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789130726.047146:0:25026:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789130726.049636:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857798144 00000100:00100000:0.0:1789130726.049648:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857798144 00000100:00100000:0.0:1789130726.049711:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130726.049721:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857798144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130726.049840:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857798144:12345-0@lo:400:kworker.0 Request processed in 121us (4436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130726.049848:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130726.049875:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857798784 00000100:00100000:0.0:1789130726.049879:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857798784 00000100:00100000:0.0:1789130726.049915:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857798912 00000100:00100000:0.0:1789130726.049918:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857798912 00000100:00100000:0.0:1789130726.049944:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789130726.049949:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857798784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130726.049983:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857798784:12345-0@lo:400:kworker.0 Request processed in 34us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130726.049990:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789130726.050002:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789130726.050008:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876038857798912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130726.050058:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876038857798912:12345-0@lo:400:kworker.0 Request processed in 50us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130726.050063:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789130726.050824:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857798016 00000100:00100000:3.0:1789130726.050831:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857798016 00000100:00100000:3.0:1789130726.050862:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130726.051098:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3642:x1876038857798016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130726.051151:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3642:x1876038857798016:12345-0@lo:400:kworker.0 Request processed in 284us (5847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130726.051157:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789130726.051204:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789130726.051236:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b84922d00 x1876038857798528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130726.051247:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130726.051256:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789130726.051264:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789130726.051268:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789130726.051272:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c90d66800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789130726.051292:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789130726.051318:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857798528:0@lo:8:kworker.0 00000004:00080000:3.0:1789130726.051381:0:24262:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789130726.051404:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24262:1876038857799296:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789130726.051501:0:24261:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789130726.052064:0:24261:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 744874449545ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789130726.052070:0:24261:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789130726.053877:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.054262:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83952600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130726.054292:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857799168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130726.054331:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.054381:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857799168 00000100:00100000:3.0:1789130726.054388:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857799168 00000100:00100000:3.0:1789130726.054438:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130726.054447:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84922d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876038857799168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130726.054489:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789130726.054536:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84922d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876038857799168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130726.054544:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789130726.054565:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789130726.054592:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb3491680 x1876038857799168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130726.054629:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3491680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857799168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130726.055013:0:25028:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789130726.055022:0:25028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1789130726.065543:0:24253:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789130726.072069:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857799296 00000100:00100000:0.0:1789130726.072082:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857799296 00000100:00100000:1.0:1789130726.072452:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857798144:0@lo:400:kworker.0 00010000:00080000:1.0:1789130726.072483:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b84922580 x1876038857798912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130726.072495:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876038857798912:0@lo:400:kworker.0 00000100:00100000:1.0:1789130726.072508:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b849230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3642:1876038857798016:0@lo:400:kworker.0 00010000:00080000:1.0:1789130726.072521:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b84921a40 x1876038857798784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130726.072529:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857798784:0@lo:400:kworker.0 00000100:00100000:1.0:1789130726.073543:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876038857798656:12345-0@lo:8:kworker.0 Request processed in 26408us (28794us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789130726.073555:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789130726.073628:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130726.073634:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789130726.073639:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857798656:0@lo:8:kworker.0 00000100:00100000:1.0:1789130726.073668:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130726.073682:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24262:x1876038857799296:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1789130726.076258:0:25026:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789130726.076268:0:25026:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789130726.076354:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24262:x1876038857799296:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2675us (22477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130726.076363:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789130726.077368:0:24262:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb3490000 x1876038857799296/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789130742 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130726.077385:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3490000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24262:1876038857799296:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789130726.077400:0:24262:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789130726.077441:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24262:1876038857799424:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789130726.077496:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130726.077536:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8762b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130726.077720:0:25029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857799424 00000100:00100000:2.0:1789130726.077727:0:25029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857799424 00000100:00100000:2.0:1789130726.077782:0:25029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130726.077792:0:25029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24262:x1876038857799424:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789130726.077819:0:25029:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1789130726.077866:0:25029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24262:x1876038857799424:12345-0@lo:5:osp-pre-0-1.0 Request processed in 76us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130726.077873:0:25029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789130726.078107:0:24262:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb359e1c0 x1876038857799424/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130742 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130726.078118:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24262:1876038857799424:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789130726.078128:0:24262:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789130726.078156:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b849212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24262:1876038857799552:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789130726.078205:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.078233:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83952000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130726.078447:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857799552 00000100:00100000:2.0:1789130726.078452:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857799552 00000100:00100000:2.0:1789130726.078493:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130726.078502:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84923c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24262:x1876038857799552:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789130726.078531:0:25342:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1789130726.122857:0:25023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1789130726.122873:0:25023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789130726.123058:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84923c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:24262:x1876038857799552:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44552us (44847us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789130726.123134:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789130726.123222:0:24262:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b849212c0 x1876038857799552/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130742 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130726.123233:0:24262:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789130726.123240:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b849212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24262:1876038857799552:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789130726.123256:0:24262:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1789130726.123304:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b849212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24262:1876038857799680:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789130726.123340:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130726.123372:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b83952000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130726.123436:0:23527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857799680 00000100:00100000:0.0:1789130726.123443:0:23527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857799680 00000100:00100000:0.0:1789130726.123500:0:23527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789130726.123509:0:23527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84920780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24262:x1876038857799680:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789130726.123558:0:23527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84920780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24262:x1876038857799680:12345-0@lo:900:osp-pre-0-1.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130726.123565:0:23527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789130726.123655:0:24262:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b849212c0 x1876038857799680/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789130742 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130726.123666:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b849212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24262:1876038857799680:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1789130726.809173:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130726.857712:0:25396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789130727.132981:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857799808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130727.133055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130727.133163:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857799808 00000100:00100000:1.0:1789130727.133171:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857799808 00000100:00100000:1.0:1789130727.133228:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789130727.133239:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857799808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130727.133274:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789130727.133322:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857799808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130727.133330:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789130727.133414:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857799808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130727.139335:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857799936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130727.139407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130727.139478:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857799936 00000100:00100000:0.0:1789130727.139487:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857799936 00000100:00100000:0.0:1789130727.139532:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789130727.139540:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857799936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130727.139810:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789130727.140665:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857799936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1122us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130727.140675:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789130727.142705:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857799936:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789130727.261833:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789130727.797589:0:25448:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130727.798920:0:25448:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789130727.832842:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130728.860524:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789130728.931334:0:25498:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130728.940339:0:25498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789130729.880706:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130730.138746:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130710/real 1789130710] req@ffff9e9cb34921c0 x1876038857789312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130730 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130730.138900:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb34921c0 x1876038857789312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130730 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130730.138911:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789130710/real 1789130710] req@ffff9e9cb3492940 x1876038857789440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130730 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130730.138925:0:3641:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e9cb3492940 x1876038857789440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789130730 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789130730.138957:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa50000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789130730.138978:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789130730.138982:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857789312:0@lo:8:kworker.0 00000100:00080000:3.0:1789130730.138988:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789130730.138993:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789130730.138996:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb3492940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857789440:0@lo:8:kworker.0 00000100:00100000:3.0:1789130730.140249:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857800064:0@lo:400:kworker.0 00000100:00100000:3.0:1789130730.140403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130730.140690:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857800064 00000100:00100000:2.0:1789130730.140699:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857800064 00000100:00100000:1.0:1789130730.140916:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857800192:0@lo:400:kworker.0 00000100:00100000:1.0:1789130730.140970:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130730.141084:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789130730.141096:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3644:x1876038857800064:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789130730.141455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130730.141460:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789130730.141464:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa50000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130730.141469:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:0.0:1789130730.141474:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789130730.141479:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e9c9fa50000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130730.141505:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359e1c0 x1876038857800320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130730.141539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130730.141542:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789130730.141544:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130730.141547:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:0.0:1789130730.141550:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789130730.141562:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9c9fa54800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130730.141576:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9c98da7c00 x1876038857800448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130730.141645:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130730.141649:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789130730.141651:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130730.141655:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 744 00000100:00080000:0.0:1789130730.141657:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789130730.141660:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e9b82105000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130730.141672:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4ea1680 x1876038857800960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130730.141717:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857800192 00000100:00100000:0.0:1789130730.141730:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857800192 00000100:00100000:0.0:1789130730.141774:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130730.141781:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c825883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857800192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.142012:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c825883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857800192:12345-0@lo:400:kworker.0 Request processed in 231us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130730.142021:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130730.142050:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876038857800576:0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.142082:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130730.142105:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876038857801216:0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.142128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130730.142349:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789130730.142360:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857800704:0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.142391:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130730.142420:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857801344:0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.142457:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130730.142494:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857800704 00000100:00100000:0.0:1789130730.142497:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857800704 00000100:00100000:0.0:1789130730.142518:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130730.142592:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857800704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.142658:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857800704:12345-0@lo:400:kworker.0 Request processed in 134us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130730.142665:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130730.142685:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857800576 00000100:00100000:0.0:1789130730.142689:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857800576 00000100:00100000:0.0:1789130730.142706:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857801216 00000100:00100000:0.0:1789130730.142709:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857801216 00000100:00100000:0.0:1789130730.142925:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857801344 00000100:00100000:0.0:1789130730.142929:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857801344 00000100:00100000:0.0:1789130730.142945:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130730.142951:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876038857800576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.142983:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876038857800576:12345-0@lo:400:kworker.0 Request processed in 33us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130730.142989:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130730.143002:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130730.143007:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876038857801216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.143033:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876038857801216:12345-0@lo:400:kworker.0 Request processed in 26us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130730.143038:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130730.143049:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130730.143054:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857801344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.143094:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857801344:12345-0@lo:400:kworker.0 Request processed in 39us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130730.143100:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130730.143131:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876038857801088:0@lo:400:kworker.0 00000100:00100000:1.0:1789130730.143337:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857800320:0@lo:8:kworker.0 00000100:00100000:1.0:1789130730.143377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130730.143413:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c98da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857800448:0@lo:8:kworker.0 00000100:00100000:1.0:1789130730.143466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130730.143484:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857800960:0@lo:8:kworker.0 00000100:00100000:1.0:1789130730.143508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130730.143984:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130730.144044:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857800192:0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.144069:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130730.144076:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857800832:0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.144101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130730.144131:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857800320 00000100:00100000:0.0:1789130730.144137:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857800320 00000100:00100000:1.0:1789130730.144351:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857801088 00000100:00100000:1.0:1789130730.144356:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857801088 00000100:00100000:1.0:1789130730.144398:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789130730.144405:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876038857801088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130730.144466:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876038857801088:12345-0@lo:400:kworker.0 Request processed in 61us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130730.144486:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789130730.144677:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857800448 00000100:00100000:0.0:1789130730.144681:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857800448 00000100:00100000:0.0:1789130730.144690:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857800960 00000100:00100000:0.0:1789130730.144693:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857800960 00000100:00100000:0.0:1789130730.144699:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857800832 00000100:00100000:0.0:1789130730.144701:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857800832 00000100:00100000:0.0:1789130730.144729:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130730.144736:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857800832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130730.144783:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857800832:12345-0@lo:400:kworker.0 Request processed in 47us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130730.144796:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130730.144808:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130730.144812:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876038857800320:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789130730.144839:0:25028:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:0.0:1789130730.144867:0:25028:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76b2fec9b0509680 00002000:00100000:0.0:1789130730.144887:0:25028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e9b848a9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789130730.144899:0:25028:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789130730.144901:0:25028:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789130730.144977:0:25028:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789130730.145002:0:25028:0:(import.c:65:import_set_state_nolock()) ffff9e9b848ab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130730.145045:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876038857800320:12345-0@lo:8:kworker.0 Request processed in 232us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130730.145053:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130730.145067:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130730.145071:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c82588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876038857800448:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789130730.145082:0:25028:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789130730.145109:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c82588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876038857800448:12345-0@lo:8:kworker.0 Request processed in 35us (1658us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789130730.145116:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130730.145126:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130730.145129:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876038857800960:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789130730.145137:0:25028:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789130730.145364:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876038857800960:12345-0@lo:8:kworker.0 Request processed in 231us (1853us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789130730.145371:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130730.145420:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857800704:0@lo:400:kworker.0 00010000:00080000:0.0:1789130730.145444:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb4ea03c0 x1876038857801344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130730.145456:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857801344:0@lo:400:kworker.0 00010000:00080000:0.0:1789130730.145469:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb4ea0f00 x1876038857800576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130730.145488:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876038857800576:0@lo:400:kworker.0 00010000:00080000:0.0:1789130730.145503:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb4ea1a40 x1876038857801216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130730.145511:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876038857801216:0@lo:400:kworker.0 00010000:00080000:1.0:1789130730.145704:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb359e1c0 x1876038857800320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130730.145713:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130730.145719:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789130730.145727:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789130730.145732:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789130730.145734:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa50000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789130730.145750:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789130730.145754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857800320:0@lo:8:kworker.0 00000100:00080000:1.0:1789130730.145767:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130730.145771:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789130730.145774:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c98da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857800448:0@lo:8:kworker.0 00000100:00080000:1.0:1789130730.145792:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789130730.145796:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789130730.145799:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857800960:0@lo:8:kworker.0 00000004:00080000:1.0:1789130730.145828:0:23539:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789130730.145897:0:23539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748968283566ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789130730.145903:0:23539:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:0.0:1789130730.146035:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb4ea0b40 x1876038857800832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130730.146045:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857800832:0@lo:400:kworker.0 00010000:00080000:0.0:1789130730.146055:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9cb4ea30c0 x1876038857801088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130730.146062:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876038857801088:0@lo:400:kworker.0 00000100:00100000:2.0:1789130730.146292:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3644:x1876038857800064:12345-0@lo:400:kworker.0 Request processed in 5185us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130730.146302:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1789130730.147732:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130730.147742:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789130730.147744:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789130730.148027:0:23540:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1789130730.148055:0:23540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23540:1876038857801600:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789130730.148113:0:23540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130730.148140:0:23540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc1299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130730.148183:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857801600 00000100:00100000:1.0:1789130730.148190:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857801600 00000100:00100000:1.0:1789130730.148249:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130730.148257:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8258b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23540:x1876038857801600:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1789130730.149317:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130730.149328:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130730.149343:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857801472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130730.149389:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130730.149591:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857801472 00000100:00100000:1.0:1789130730.149598:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857801472 00000100:00100000:1.0:1789130730.149654:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130730.149661:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876038857801472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130730.149689:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789130730.149744:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876038857801472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130730.149752:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789130730.151359:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9c82588b40 x1876038857801472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130730.151388:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857801472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130730.154443:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857800064:0@lo:400:kworker.0 00002000:00080000:2.0:1789130730.154921:0:25028:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789130730.154930:0:25028:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789130730.154936:0:25028:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:1.0:1789130730.169605:0:23495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789130730.183063:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.183078:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.183096:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.183101:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.183107:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.183126:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.183136:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.183156:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.183535:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130730.184515:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.184542:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.184555:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.184559:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.184564:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.184575:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.184585:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.184593:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.185738:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130730.185752:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.185775:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983a00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.185781:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.185800:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.185841:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.185849:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b0509687 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.186260:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789130730.186993:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1789130730.194212:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.194230:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.194249:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.194264:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.194272:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.194464:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.194476:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.194484:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.194499:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130730.196205:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.196217:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.196232:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.196236:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.196242:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.196255:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.196265:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.196405:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.196418:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789130730.197430:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.197450:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.197464:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.197468:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.197473:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.197485:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.197495:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.197503:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.197514:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789130730.200071:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.200085:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.200108:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.200113:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.200120:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.200134:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.201124:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.201138:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.201162:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789130730.202670:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789130730.202680:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202692:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.202697:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202708:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202729:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202746:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b0509695 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202766:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789130730.202782:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202895:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982400 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.202899:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202907:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202919:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202926:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b050969c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202940:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130730.202943:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202949:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.202957:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202964:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202974:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202980:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.202992:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130730.202996:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.203001:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983c00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.203005:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.203011:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.203019:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.203026:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.203044:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.203046:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.203049:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.203591:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.203601:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983e00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130730.203604:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.203627:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.203652:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.203659:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b050968e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.203673:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.203675:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.203676:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.204218:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.204228:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.204239:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.204243:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.204250:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.204263:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.204271:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.204291:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.204320:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130730.205262:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130730.205271:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.205293:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.205297:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.205306:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.205320:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.205327:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003c14517/0x76b2fec9b05096b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.205346:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.205347:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.205349:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.205513:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.205520:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.205545:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.205549:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.205553:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.205564:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.205571:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.205577:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.205602:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130730.206300:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130730.206308:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.206328:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983000 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.206332:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.206341:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.206356:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.206363:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9f7c8c2/0x76b2fec9b05096b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.206379:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.206381:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.206383:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.207099:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.207110:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.207121:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.207133:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.207140:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.207224:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.207235:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.207241:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.207265:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130730.208035:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.208043:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.208053:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.208057:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.208061:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.208071:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.208080:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.208096:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.208119:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789130730.208133:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130730.208138:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.208238:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130730.208244:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.208253:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983400 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.208257:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.208266:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.208364:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.208373:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f26963d/0x76b2fec9b05096c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.208394:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.208396:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.208398:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.209238:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130730.209243:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.209252:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.209265:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.209273:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.209368:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.209370:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.209372:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.209986:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.209990:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.209992:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.216829:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.216854:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.216872:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.216878:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.216885:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.216901:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.216912:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.216920:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.216952:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130730.217248:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130730.217256:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.217265:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983e00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.217270:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.217292:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.217312:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.217321:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f297a6f6/0x76b2fec9b05096cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.217340:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.217342:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.217350:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.218164:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.218173:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.218186:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.218191:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.218196:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.218208:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.218226:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.218235:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.218261:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130730.218696:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130730.218704:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.218713:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983c00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.218717:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.218737:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.218752:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.218759:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000643c3c24/0x76b2fec9b05096d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.218797:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.218798:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.218800:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.219152:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.219159:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.219169:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.219173:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.219178:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.219188:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.219195:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.219203:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.219241:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130730.220092:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130730.220100:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.220111:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.220115:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.220150:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.220166:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.220173:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e883e728/0x76b2fec9b05096db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.220194:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.220196:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.220198:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.220553:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.220572:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.220584:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.220588:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.220594:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.220604:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.220640:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.220648:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.220667:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130730.221024:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130730.221030:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.221038:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982400 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.221041:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.221050:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.221063:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.221085:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a612a8/0x76b2fec9b05096e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.221099:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.221101:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.221103:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.222854:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.222868:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.222885:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.222897:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.222905:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.222919:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.222930:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.222938:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.223008:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130730.223961:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.223970:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.223980:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.223984:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.223989:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.223999:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.224007:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.224021:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229187:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130730.229206:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229221:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.229226:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229240:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229272:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229292:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003868d121/0x76b2fec9b05096e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229312:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130730.229316:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229332:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.229335:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229342:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229352:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.229358:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.229360:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.229362:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.229840:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789130730.229849:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e77253f7/0x76b2fec9b05096f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789130730.230841:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.230852:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.230865:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.230870:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.230878:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.230892:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.230903:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.230911:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.231098:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.231252:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789130730.235022:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.235038:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.235059:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.235065:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.235071:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.235086:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.235096:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.235104:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.240160:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130730.240174:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.240187:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983a00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.240192:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.240204:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.240224:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.240240:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4912097/0x76b2fec9b05096f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.240318:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130730.240324:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.240331:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:3.0:1789130730.240334:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.240342:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.240365:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.240373:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.240374:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.240376:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.240691:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789130730.240699:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b05096fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.240786:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130730.242899:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130730.242913:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.242930:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=749s v=(0 0) 00010000:00010000:2.0:1789130730.242935:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130730.242942:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.242955:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.242966:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.242973:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.243037:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789130730.246518:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130730.246546:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.246563:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1789130730.246567:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130730.246574:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.246588:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.246599:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.246607:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.250189:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789130730.250511:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130730.250521:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250551:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a93c00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.250556:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250569:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250592:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250600:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa1921b7/0x76b2fec9b0509705 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250641:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130730.250645:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250652:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6b200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.250655:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250663:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250672:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250684:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e149efd2/0x76b2fec9b050970c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.250698:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.250700:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.250702:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130730.251321:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130730.251328:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.251340:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=749s v=(0 0) 00010000:00010000:2.0:1789130730.251345:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130730.251352:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.251363:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.251372:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.251380:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.251402:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130730.251675:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130730.251682:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.251690:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a93a00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.251695:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.251704:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.251718:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.251726:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef6aab96/0x76b2fec9b0509713 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.251743:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.251744:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.251746:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130730.252056:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130730.252066:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252075:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=749s v=(0 0) 00010000:00010000:2.0:1789130730.252078:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130730.252083:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252092:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252101:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252107:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252117:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789130730.252708:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130730.252716:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252725:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=749s v=(0 0) 00010000:00010000:2.0:1789130730.252728:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130730.252733:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252742:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252758:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252868:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.252893:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789130730.253814:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130730.253823:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253833:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353ea00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.253846:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253857:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253875:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253883:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065e5465c/0x76b2fec9b050971a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253907:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130730.253910:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253917:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353ee00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.253920:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253933:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253944:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253951:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb2feaf2/0x76b2fec9b0509721 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.253973:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.253975:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.253976:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130730.254456:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130730.254464:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.254474:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=749s v=(0 0) 00010000:00010000:2.0:1789130730.254477:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130730.254483:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.254493:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.254502:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.254509:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.254696:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130730.255778:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130730.255789:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.255800:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.255804:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.255815:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.255831:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.255840:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027c37f67/0x76b2fec9b0509728 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.255863:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.255865:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.255867:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130730.256242:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130730.256249:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.256260:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=749s v=(0 0) 00010000:00010000:2.0:1789130730.256264:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130730.256271:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.256463:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.256475:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.256482:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.256509:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789130730.257310:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130730.257319:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.257329:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=749s v=(0 0) 00010000:00010000:2.0:1789130730.257340:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130730.257346:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.257357:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.257366:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.257373:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.257397:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789130730.257560:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130730.257567:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257582:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f400 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130730.257587:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257597:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257646:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257655:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001064f596/0x76b2fec9b050972f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257678:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130730.257681:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257688:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130730.257691:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257699:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257708:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257722:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000200455e5/0x76b2fec9b0509736 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.257737:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.257739:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130730.257740:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.258497:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130730.264803:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130730.264816:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.264843:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1789130730.264848:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130730.264856:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.264871:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.264882:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.264889:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.264915:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130730.265803:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130730.265814:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.265825:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6b600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.265830:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.265840:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.265861:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.265884:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d23234/0x76b2fec9b050973d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.265909:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.265911:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.265912:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130730.266136:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130730.266156:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266166:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1789130730.266170:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130730.266176:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266187:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266208:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266215:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266231:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789130730.266839:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130730.266847:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266856:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1789130730.266860:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130730.266864:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266874:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266882:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266888:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.266912:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789130730.267014:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130730.267020:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267029:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6ae00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.267033:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267041:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267054:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267062:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8cfe435/0x76b2fec9b0509744 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267079:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130730.267083:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267089:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6ba00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130730.267092:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267111:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267121:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267129:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b226a87/0x76b2fec9b050974b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267154:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.267156:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130730.267158:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130730.267948:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130730.267957:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267969:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1789130730.267973:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130730.267979:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267990:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.267999:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.268015:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130730.268034:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130730.268266:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130730.268273:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.268297:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130730.268301:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.268309:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.268323:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.268329:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509752 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130730.268345:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.268347:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.268348:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130730.268726:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.269260:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.269411:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130730.270847:0:25028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130730.270860:0:25028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.270877:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=749s v=(0 0) 00010000:00010000:1.0:1789130730.270882:0:25028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130730.270889:0:25028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.270903:0:25028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.270913:0:25028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.270922:0:25028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130730.270950:0:25028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789130730.271040:0:25028:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:3.0:1789130730.271305:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130730.271313:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.271322:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:3.0:1789130730.271327:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.271337:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.271355:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.271363:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063061acf/0x76b2fec9b0509759 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130730.271384:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.271393:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130730.271396:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130730.271510:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8258b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23540:x1876038857801600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 123249us (123391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130730.271523:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130730.271596:0:23540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23540:1876038857801600:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789130730.271745:0:23540:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1789130730.271861:0:23540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23540:1876038857801728:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789130730.271902:0:23540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130730.271972:0:23540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c90f2fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130730.271992:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857801728 00000100:00100000:1.0:1789130730.271998:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857801728 00000100:00100000:3.0:1789130730.274628:0:25029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130730.274650:0:25029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c82588b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23540:x1876038857801728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789130730.274703:0:25029:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1789130730.295511:0:25023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1789130730.296445:0:25023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789130730.296986:0:25029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c82588b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:23540:x1876038857801728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22338us (25077us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789130730.296999:0:25029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789130730.297120:0:23540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789130730.297130:0:23540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23540:1876038857801728:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789130730.297923:0:23540:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1789130730.908086:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130731.225765:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130731.225788:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857801856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130731.225870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130731.225995:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857801856 00000100:00100000:1.0:1789130731.226003:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857801856 00000100:00100000:1.0:1789130731.226054:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130731.226063:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84921e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857801856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130731.226088:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789130731.226207:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84921e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857801856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130731.226217:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130731.226261:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84920f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857801856:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130731.933429:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130732.255734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130732.255801:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857801984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130732.255886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130732.255955:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857801984 00000100:00100000:2.0:1789130732.255963:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857801984 00000100:00100000:2.0:1789130732.256014:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130732.256023:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857801984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130732.256057:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789130732.256104:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857801984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130732.256111:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130732.256651:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857801984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130732.262249:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857802112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130732.262327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130732.262597:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857802112 00000100:00100000:2.0:1789130732.262605:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857802112 00000100:00100000:2.0:1789130732.262673:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130732.262682:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b849230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857802112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130732.262714:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789130732.262761:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b849230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857802112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130732.262768:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130732.262877:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857802112:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789130732.952698:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130733.404479:0:24277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789130733.977835:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130735.009039:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130735.321296:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130735.321320:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857802240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130735.321402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130735.321474:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857802240 00000100:00100000:1.0:1789130735.321497:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857802240 00000100:00100000:1.0:1789130735.321551:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130735.321560:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c82589e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857802240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130735.321591:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789130735.321668:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c82589e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857802240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130735.321675:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130735.321898:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857802240:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789130735.322042:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130735.322554:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3645:1876038857802368:0@lo:400:kworker.0 00000100:00100000:1.0:1789130735.322648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130735.322958:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857802368 00000100:00100000:0.0:1789130735.322964:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857802368 00000100:00100000:0.0:1789130735.323005:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789130735.323013:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3645:x1876038857802368:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789130735.323110:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130735.323114:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789130735.323117:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789130735.323123:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 748 00000100:00080000:2.0:1789130735.323127:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789130735.323131:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9c9fa54800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130735.323153:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b820cd680 x1876038857802624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130735.323226:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3645:x1876038857802368:12345-0@lo:400:kworker.0 Request processed in 213us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130735.323233:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789130735.325252:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789130735.325258:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789130735.325261:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789130735.325268:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 748 00000100:00080000:2.0:1789130735.325272:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789130735.325278:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e9b82105000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1789130735.325299:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b820ce580 x1876038857803136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789130735.325352:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857802880:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.325419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325457:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857803520:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.325483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325551:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130735.325557:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857803008:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.325583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325632:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857802496:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.325672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325690:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857803264:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.325730:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325748:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789130735.325755:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876038857802752:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.325775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325803:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876038857803392:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.325824:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325846:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857802624:0@lo:8:kworker.0 00000100:00100000:2.0:1789130735.325867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325883:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b820ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857803136:0@lo:8:kworker.0 00000100:00100000:2.0:1789130735.325902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.325937:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857803520 00000100:00100000:2.0:1789130735.325944:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857803520 00000100:00100000:2.0:1789130735.325990:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857803264 00000100:00100000:2.0:1789130735.325993:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857803264 00000100:00100000:2.0:1789130735.326006:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857802752 00000100:00100000:2.0:1789130735.326008:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857802752 00000100:00100000:2.0:1789130735.326019:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857803392 00000100:00100000:2.0:1789130735.326022:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857803392 00000100:00100000:2.0:1789130735.326038:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130735.326045:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857803520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326097:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857803520:12345-0@lo:400:kworker.0 Request processed in 51us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.326103:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130735.326121:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130735.326128:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857803264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326170:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876038857803264:12345-0@lo:400:kworker.0 Request processed in 42us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.326176:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130735.326189:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130735.326195:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876038857802752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326220:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876038857802752:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.326225:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130735.326236:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130735.326242:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94513c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876038857803392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326284:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94513c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876038857803392:12345-0@lo:400:kworker.0 Request processed in 42us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.326291:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130735.326310:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857803008 00000100:00100000:2.0:1789130735.326313:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857803008 00000100:00100000:2.0:1789130735.326343:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857802624 00000100:00100000:2.0:1789130735.326345:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857802624 00000100:00100000:2.0:1789130735.326354:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857803136 00000100:00100000:2.0:1789130735.326356:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857803136 00000100:00100000:2.0:1789130735.326364:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130735.326370:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857803008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326412:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857803008:12345-0@lo:400:kworker.0 Request processed in 41us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.326418:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130735.326430:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789130735.326433:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94510b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1876038857802624:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789130735.326461:0:25342:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789130735.326504:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94510b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1876038857802624:12345-0@lo:8:kworker.0 Request processed in 69us (636us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789130735.326511:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789130735.326522:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789130735.326526:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c945121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1876038857803136:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789130735.326536:0:25342:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789130735.326558:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c945121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1876038857803136:12345-0@lo:8:kworker.0 Request processed in 30us (655us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789130735.326564:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789130735.326581:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857802880 00000100:00100000:2.0:1789130735.326585:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857802880 00000100:00100000:2.0:1789130735.326601:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857802496 00000100:00100000:2.0:1789130735.326603:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857802496 00000100:00100000:2.0:1789130735.326640:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789130735.326647:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857802880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326679:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857802880:12345-0@lo:400:kworker.0 Request processed in 33us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.326685:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789130735.326696:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130735.326701:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b820ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857802496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326725:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b820ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857802496:12345-0@lo:400:kworker.0 Request processed in 24us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.326730:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789130735.326755:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130735.326759:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130735.326768:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789130735.326799:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130735.326806:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130735.326809:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857802624:0@lo:8:kworker.0 00000100:00080000:2.0:1789130735.326820:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789130735.326823:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789130735.326826:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857803136:0@lo:8:kworker.0 00010000:00080000:2.0:1789130735.326863:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b820cde00 x1876038857802752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130735.326874:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876038857802752:0@lo:400:kworker.0 00010000:00080000:2.0:1789130735.326884:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b820cc3c0 x1876038857803392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130735.326892:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876038857803392:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326902:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857802496:0@lo:400:kworker.0 00010000:00080000:2.0:1789130735.326912:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b820cc780 x1876038857803264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130735.326920:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876038857803264:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326953:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857803008:0@lo:400:kworker.0 00000100:00100000:2.0:1789130735.326963:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857802880:0@lo:400:kworker.0 00010000:00080000:2.0:1789130735.326973:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e9b820ce1c0 x1876038857803520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130735.326981:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857803520:0@lo:400:kworker.0 00000100:00100000:1.0:1789130735.327580:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b820cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3645:1876038857802368:0@lo:400:kworker.0 00000020:01000004:0.0:1789130735.715597:0:25844:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789130735.715602:0:25844:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789130735.715603:0:25844:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789130735.716037:0:25844:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e9cac2da800 00000020:01000004:0.0:1789130735.716056:0:25844:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789130735.716071:0:25844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789130735.716086:0:25844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e9c83459a48) 00000020:00000080:0.0:1789130735.716104:0:25844:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789130735.797971:0:25844:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789130735.798711:0:25844:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789130735.799588:0:25844:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789130735.799923:0:25844:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789130735.800222:0:25844:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789130735.800521:0:25844:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789130735.800931:0:25844:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1789130735.811026:0:25844:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789130735.811590:0:25844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789130735.811605:0:25844:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789130735.811661:0:25844:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x76b2fec9b0509767 00000020:01000004:2.0:1789130735.811668:0:25844:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789130735.811692:0:25844:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789130735.811696:0:25844:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789130735.811703:0:25844:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789130735.811734:0:25844:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789130735.811739:0:25844:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789130735.869180:0:25844:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789130735.869228:0:25844:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.110@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789130735.869232:0:25844:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789130735.869234:0:25844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789130735.869236:0:25844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130735.869237:0:25844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130735.869238:0:25844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130735.869240:0:25844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130735.869241:0:25844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789130735.869243:0:25844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130735.869244:0:25844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789130735.869248:0:25844:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789130735.869251:0:25844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789130735.869252:0:25844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789130735.869253:0:25844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130735.869254:0:25844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130735.869255:0:25844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130735.869256:0:25844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130735.869257:0:25844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789130735.869258:0:25844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130735.869259:0:25844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789130735.869293:0:25844:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789130735.869318:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857803648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789130735.869433:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130735.869498:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91768240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130735.869514:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857803648 00000100:00100000:2.0:1789130735.869521:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857803648 00000100:00100000:2.0:1789130735.869584:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789130735.869595:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25844:x1876038857803648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789130735.869666:0:23510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789130735.869670:0:23510:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789130735.869673:0:23510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789130735.870042:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25844:x1876038857803648:12345-0@lo:253:mount.lustre.0 Request processed in 449us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.870050:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789130735.870151:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857803648:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789130735.870162:0:25844:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789130735.870165:0:25844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789130735.870166:0:25844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789130735.870178:0:25844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789130735.870179:0:25844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789130735.870180:0:25844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789130735.870181:0:25844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789130735.870183:0:25844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789130735.870184:0:25844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789130735.870185:0:25844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789130735.870206:0:25844:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e9cac2da800 from lustre-OST0001 10000000:01000000:1.0:1789130735.870233:0:25844:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789130735.870236:0:25844:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789130735.870244:0:25844:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e9b841b1a48 local copy 00010000:00010000:1.0:1789130735.870254:0:25844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130735.870349:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857803776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130735.870389:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130735.870428:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91768240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130735.871838:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857803776 00000100:00100000:2.0:1789130735.871849:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857803776 00000100:00100000:2.0:1789130735.872173:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789130735.872184:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25844:x1876038857803776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130735.872321:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25844:x1876038857803776:12345-0@lo:501:mount.lustre.0 Request processed in 140us (1940us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130735.872328:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789130735.872424:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857803776:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789130735.872449:0:25844:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789130735.872482:0:25844:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789130735.872491:0:25844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.872501:0:25844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95400/0x76b2fec9b05093a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05093a8 expref: -99 pid: 23494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130735.872535:0:25844:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e9cac2da800 10000000:01000000:3.0:1789130735.872552:0:25844:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789130735.872558:0:25844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789130735.872560:0:25844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130735.872565:0:25844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789130735.872567:0:25844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789130735.872599:0:25844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94c00/0x76b2fec9b050976e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.872608:0:25844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94c00/0x76b2fec9b050976e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.872655:0:25844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94c00/0x76b2fec9b050976e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130735.872698:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857803904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130735.872760:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130735.879319:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8763b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130735.884822:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857803904 00000100:00100000:1.0:1789130735.884840:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857803904 00000100:00100000:1.0:1789130735.884910:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789130735.884920:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:25844:x1876038857803904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789130735.884936:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130735.884955:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83983400/0x76b2fec9b0509775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050976e expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130735.884985:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83983400/0x76b2fec9b0509775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050976e expref: 22 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130735.884996:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83983400/0x76b2fec9b0509775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050976e expref: 22 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130735.885006:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83983400, rc 0) 00000100:00100000:1.0:1789130735.885177:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857803904:12345-0@lo:101:mount.lustre.0 Request processed in 257us (12415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130735.885184:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789130735.891196:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857803904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130735.891231:0:25844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94c00/0x76b2fec9b050976e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509775 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.891244:0:25844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94c00/0x76b2fec9b050976e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509775 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130735.895213:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789130735.899115:0:25844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130735.900943:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789130735.900990:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789130735.902427:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789130735.902454:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789130735.902595:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789130735.902607:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789130735.902791:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789130735.902808:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789130735.902843:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789130735.902869:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789130735.902875:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789130735.902997:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130735.903098:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130735.903206:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8763bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130735.908811:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857804032 00000100:00100000:1.0:1789130735.908828:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857804032 00000100:00100000:1.0:1789130735.908943:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789130735.908955:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789130735.909191:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804032:12345-0@lo:501:mount.lustre.0 Request processed in 238us (6093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130735.909215:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789130735.909336:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130735.909407:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130735.909503:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130735.917884:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8763bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789130735.918040:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857804160 00000100:00100000:0.0:1789130735.918051:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857804160 00000100:00100000:0.0:1789130735.918144:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789130735.918155:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789130735.923232:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804160:12345-0@lo:503:mount.lustre.0 Request processed in 5067us (13717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130735.923251:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789130735.929952:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804160:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789130735.942956:0:25844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789130735.943402:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130735.943542:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130735.943593:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c876a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130735.944080:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857804288 00000100:00100000:0.0:1789130735.944089:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857804288 00000100:00100000:0.0:1789130735.944155:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789130735.944165:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789130735.945028:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804288:12345-0@lo:502:mount.lustre.0 Request processed in 861us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130735.945039:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789130735.945358:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789130735.946705:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789130735.947038:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789130735.947055:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789130735.947069:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789130735.947278:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789130735.947412:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789130735.947438:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789130735.947466:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789130735.947908:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1789130735.947955:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130735.948053:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130735.948100:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cbc129a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130735.948208:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857804416 00000100:00100000:2.0:1789130735.948216:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857804416 00000100:00100000:2.0:1789130735.948268:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789130735.948279:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130735.948452:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804416:12345-0@lo:502:mount.lustre.0 Request processed in 174us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130735.948469:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789130735.948728:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130735.948802:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1789130735.948812:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789130735.951212:0:25848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789130735.951224:0:25848:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789130735.951232:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130735.951235:0:25848:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789130735.951242:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789130735.951261:0:25848:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e9cb3be8000) 00000020:00000080:2.0:1789130735.951291:0:25848:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789130735.951371:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789130735.952250:0:25848:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9cac2da800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789130735.952264:0:25848:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789130735.952275:0:25848:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x76b2fec9b0509783 00010000:00010000:3.0:1789130735.975259:0:25848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789130735.978177:0:25848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1789130735.988263:0:25848:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:1.0:1789130735.998245:0:25848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789130735.998259:0:25848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130735.998269:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130735.998271:0:25848:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789130735.998274:0:25848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130735.998279:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130735.998280:0:25848:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789130735.998283:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789130735.998286:0:25848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789130735.998288:0:25848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130735.998290:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130735.998302:0:25848:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789130735.998306:0:25848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130735.998309:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130735.998311:0:25848:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789130735.998314:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789130735.998344:0:25848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130735.998361:0:25848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130735.998362:0:25848:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789130735.998366:0:25848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789130735.999039:0:25844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789130735.999073:0:25844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789130735.999093:0:25844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94c00/0x76b2fec9b050976e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509775 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.999105:0:25844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94c00/0x76b2fec9b050976e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509775 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130735.999125:0:25844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9cac2da800 from 1 10000000:01000000:3.0:1789130735.999128:0:25844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130735.999162:0:25844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.999170:0:25844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.999182:0:25844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130735.999206:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130735.999277:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130735.999332:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857804544 00000100:00100000:3.0:1789130735.999339:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857804544 00000100:00100000:3.0:1789130735.999395:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789130735.999404:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:25844:x1876038857804544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130735.999428:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130735.999442:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b050978a expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.999482:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b050978a expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.999494:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050978a expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.999503:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb94800, rc 0) 00000100:00100000:3.0:1789130735.999544:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857804544:12345-0@lo:101:mount.lustre.0 Request processed in 141us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130735.999552:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789130735.999595:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8763b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130735.999646:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130735.999661:0:25844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130735.999670:0:25844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130736.018465:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:3.0:1789130736.018805:0:25844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130736.019018:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789130736.019044:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789130736.019060:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789130736.019071:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789130736.019085:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789130736.019099:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789130736.019112:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789130736.019125:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:3.0:1789130736.019138:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:3.0:1789130736.019150:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:3.0:1789130736.019163:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:3.0:1789130736.019174:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:3.0:1789130736.019185:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:3.0:1789130736.019215:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:3.0:1789130736.019230:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:3.0:1789130736.019243:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:3.0:1789130736.019256:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:3.0:1789130736.019272:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:3.0:1789130736.019285:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:3.0:1789130736.020044:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130736.020124:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.020216:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8763ba80 going to sleep for 11 seconds 00010000:00010000:3.0:1789130736.025849:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130736.025990:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857804672 00000100:00100000:2.0:1789130736.026003:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857804672 00000100:00100000:3.0:1789130736.026765:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789130736.026777:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c851e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857804672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130736.026954:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c851e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857804672:12345-0@lo:501:mount.lustre.0 Request processed in 179us (6829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.026962:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789130736.027515:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84922580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130736.027571:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130736.027662:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130736.027694:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c87dd6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130736.028361:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857804800 00000100:00100000:3.0:1789130736.028367:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857804800 00000100:00100000:3.0:1789130736.028425:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789130736.028434:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c851e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857804800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130736.028560:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c851e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857804800:12345-0@lo:503:mount.lustre.0 Request processed in 128us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.028566:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789130736.028851:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789130736.029222:0:25844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789130736.029435:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130736.029787:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130736.029862:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c82adf480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130736.033912:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857804928 00000100:00100000:1.0:1789130736.033929:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857804928 00000100:00100000:1.0:1789130736.034025:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789130736.034036:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857804928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789130736.034232:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857804928:12345-0@lo:502:mount.lustre.0 Request processed in 197us (4444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130736.034242:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789130736.034354:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857804928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789130736.034722:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789130736.034754:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789130736.034769:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789130736.034784:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789130736.034798:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789130736.034811:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789130736.034824:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789130736.034837:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:2.0:1789130736.034851:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:2.0:1789130736.034863:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:2.0:1789130736.034877:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:2.0:1789130736.034892:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:2.0:1789130736.034905:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:2.0:1789130736.034918:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:2.0:1789130736.034932:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:2.0:1789130736.034964:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:2.0:1789130736.034981:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:2.0:1789130736.035028:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130736.035089:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130736.040590:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c82adf480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130736.041737:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857805056 00000100:00100000:3.0:1789130736.041751:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857805056 00000100:00100000:3.0:1789130736.041809:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789130736.041822:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857805056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130736.042033:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857805056:12345-0@lo:502:mount.lustre.0 Request processed in 213us (6942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.042042:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789130736.043553:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789130736.043674:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:2.0:1789130736.043698:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:0.0:1789130736.047571:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130736.047587:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047590:0:25852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789130736.047599:0:25852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9cac2da800 00000020:00000080:0.0:1789130736.047602:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130736.047634:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130736.047638:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047639:0:25852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789130736.047643:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130736.047645:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047646:0:25852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789130736.047650:0:25852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e9cac2da800 00000020:00000080:0.0:1789130736.047651:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130736.047722:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130736.047725:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047726:0:25852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789130736.047728:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130736.047730:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047732:0:25852:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789130736.047735:0:25852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9cac2da800 00000020:00000080:0.0:1789130736.047737:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130736.047755:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130736.047757:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047758:0:25852:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789130736.047761:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130736.047763:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047770:0:25852:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789130736.047839:0:25852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9cac2da800 00000020:00000080:0.0:1789130736.047844:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130736.047863:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130736.047866:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047867:0:25852:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789130736.047870:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130736.047873:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047874:0:25852:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789130736.047878:0:25852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9cac2da800 00000020:00000080:0.0:1789130736.047880:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130736.047904:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130736.047907:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047908:0:25852:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789130736.047910:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130736.047913:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047914:0:25852:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789130736.047918:0:25852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e9cac2da800 00000020:00000080:0.0:1789130736.047920:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130736.047940:0:25852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130736.047942:0:25852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130736.047943:0:25852:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789130736.047946:0:25852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:3.0:1789130736.054681:0:25844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789130736.054729:0:25844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130736.054755:0:25844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130736.054774:0:25844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130736.054838:0:25844:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789130736.054842:0:25844:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e9cac2da800 10000000:01000000:3.0:1789130736.054845:0:25844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e9cac2da800 10000000:01000000:3.0:1789130736.054849:0:25844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130736.054855:0:25844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e9cac2da800 from 1 10000000:01000000:3.0:1789130736.054858:0:25844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130736.054901:0:25844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94400/0x76b2fec9b0509798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130736.054909:0:25844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94400/0x76b2fec9b0509798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130736.054920:0:25844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94400/0x76b2fec9b0509798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130736.054947:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789130736.055028:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.055072:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857805184 00000100:00100000:3.0:1789130736.055079:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857805184 00000100:00100000:3.0:1789130736.055124:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789130736.055132:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:25844:x1876038857805184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130736.055146:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130736.055159:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb95c00/0x76b2fec9b050979f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b0509798 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130736.055193:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb95c00/0x76b2fec9b050979f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b0509798 expref: 24 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130736.055204:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb95c00/0x76b2fec9b050979f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509798 expref: 24 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130736.055213:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb95c00, rc 0) 00000100:00100000:3.0:1789130736.055244:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805184:12345-0@lo:101:mount.lustre.0 Request processed in 112us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.055251:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789130736.056671:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c8763b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130736.056708:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789130736.056730:0:25844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94400/0x76b2fec9b0509798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050979f expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130736.056742:0:25844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94400/0x76b2fec9b0509798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b050979f expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789130736.065213:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789130736.067754:0:25844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130736.068005:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789130736.068033:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789130736.068061:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789130736.068088:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789130736.068104:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789130736.068118:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789130736.068132:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789130736.068146:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789130736.068172:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789130736.068186:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789130736.068200:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789130736.068214:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789130736.068228:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789130736.068242:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789130736.068255:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789130736.068268:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789130736.068280:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789130736.068293:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789130736.068321:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789130736.068338:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789130736.068353:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789130736.070807:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789130736.070838:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789130736.070855:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789130736.070868:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789130736.070883:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789130736.070899:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789130736.070914:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789130736.070928:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789130736.070945:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789130736.070960:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789130736.070975:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789130736.070991:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789130736.071005:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789130736.071046:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789130736.071062:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789130736.071088:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789130736.071104:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789130736.071118:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789130736.071132:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789130736.071145:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789130736.071170:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789130736.071184:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789130736.071197:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789130736.071208:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789130736.071219:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789130736.071232:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789130736.071245:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789130736.073233:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789130736.073716:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789130736.073750:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789130736.073756:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789130736.073879:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130736.073959:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.074026:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857805312 00000100:00100000:3.0:1789130736.074035:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857805312 00000100:00100000:3.0:1789130736.074144:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789130736.074154:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789130736.074283:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805312:12345-0@lo:501:mount.lustre.0 Request processed in 130us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.074290:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789130736.079688:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c91591d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130736.079738:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789130736.079799:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789130736.079883:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130736.079914:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c86889c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130736.082580:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857805440 00000100:00100000:3.0:1789130736.082593:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857805440 00000100:00100000:3.0:1789130736.082660:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789130736.082669:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789130736.082834:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805440:12345-0@lo:503:mount.lustre.0 Request processed in 165us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.082842:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789130736.082922:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789130736.083424:0:25844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130736.084418:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130736.084781:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.084817:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857805568 00000100:00100000:3.0:1789130736.084823:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857805568 00000100:00100000:3.0:1789130736.084870:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789130736.084879:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130736.084988:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805568:12345-0@lo:502:mount.lustre.0 Request processed in 109us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.084995:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789130736.085046:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130736.085069:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130736.085271:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789130736.085317:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789130736.085333:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789130736.085346:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789130736.085358:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789130736.085371:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789130736.085397:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789130736.085411:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789130736.085435:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789130736.085450:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789130736.086658:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789130736.086684:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789130736.086721:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789130736.086737:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789130736.086750:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789130736.086764:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789130736.086791:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789130736.086805:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789130736.086817:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789130736.086831:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789130736.086846:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789130736.086859:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789130736.086870:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789130736.086883:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789130736.086896:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1789130736.086908:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1789130736.086922:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1789130736.086936:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1789130736.086965:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1789130736.086978:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1789130736.086993:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1789130736.087005:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1789130736.087016:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1789130736.087028:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1789130736.087042:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1789130736.087056:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1789130736.087069:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1789130736.087084:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1789130736.087098:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1789130736.087110:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1789130736.087123:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1789130736.087138:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1789130736.087153:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1789130736.087166:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1789130736.087193:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1789130736.087208:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1789130736.087221:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1789130736.087233:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1789130736.087287:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130736.088898:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.088988:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130736.096675:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857805696 00000100:00100000:2.0:1789130736.096691:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857805696 00000100:00100000:3.0:1789130736.099685:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789130736.099707:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130736.099899:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805696:12345-0@lo:502:mount.lustre.0 Request processed in 201us (11003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.099910:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789130736.100002:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130736.100212:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1789130736.100239:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1789130736.100272:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789130736.100818:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.100851:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c883adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130736.100915:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857805824 00000100:00100000:2.0:1789130736.100921:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857805824 00000100:00100000:2.0:1789130736.100965:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789130736.100973:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789130736.101069:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857805824:12345-0@lo:502:mount.lustre.0 Request processed in 96us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130736.101076:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789130736.101157:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857805824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789130736.101205:0:25844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789130736.101214:0:25844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789130736.106667:0:25858:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789130736.113650:0:25858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e9cb3beced8) 00000020:00000080:2.0:1789130736.113692:0:25858:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789130736.113805:0:25858:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9cac2da800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789130736.113810:0:25858:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9cac2da800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789130736.113812:0:25858:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9cac2da800 3 00010000:00080000:2.0:1789130736.114025:0:25858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9cabd01800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.110@tcp at head 00010000:00010000:3.0:1789130736.124042:0:25858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789130736.128279:0:25858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789130736.128345:0:25858:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789130736.128361:0:25858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x76b2fec9b05097ad 00000100:00080000:3.0:1789130736.128374:0:25858:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789130736.128391:0:25858:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e9cabd01800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130736.128446:0:25858:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b84921a40 x1876038857805952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130736.135188:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876038857805952:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789130736.135337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789130736.135447:0:25858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789130736.137962:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857805952 00000100:00100000:1.0:1789130736.137991:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857805952 00000100:00100000:1.0:1789130736.138057:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130736.138065:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b849221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1876038857805952:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789130736.138098:0:23516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 754 last 0 00000020:00000080:1.0:1789130736.138142:0:23516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x76b2fec9b05097b4 00000004:00100000:1.0:1789130736.138162:0:23516:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789130736.138201:0:23516:0:(import.c:65:import_set_state_nolock()) ffff9e9b8480c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130736.138310:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b849221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876038857805952:12345-0@lo:38:llog_process_th.0 Request processed in 244us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130736.138319:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789130736.140131:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b84921a40 x1876038857805952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130736.140147:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130736.140160:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789130736.140181:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789130736.140187:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789130736.140191:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9cabd01800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789130736.140198:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876038857805952:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1789130736.140343:0:25858:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789130736.140863:0:25858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e9cb4efb490) 00000020:00000080:3.0:1789130736.140888:0:25858:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789130736.140972:0:25858:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e9cac2da800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789130736.140977:0:25858:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e9cac2da800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789130736.140980:0:25858:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e9cac2da800 3 00010000:00080000:3.0:1789130736.141014:0:25858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e9c834fc800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.110@tcp at head 00010000:00010000:3.0:1789130736.147901:0:25858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789130736.148155:0:25858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789130736.148204:0:25858:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789130736.148217:0:25858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x76b2fec9b05097c2 00000100:00080000:3.0:1789130736.148228:0:25858:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789130736.148234:0:25858:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e9c834fc800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1789130736.148273:0:25858:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9b84921a40 x1876038857806080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130736.148312:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876038857806080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789130736.153476:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.153555:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857806080 00000100:00100000:3.0:1789130736.153564:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857806080 00000100:00100000:3.0:1789130736.153605:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130736.153631:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876038857806080:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789130736.153665:0:23515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 754 last 0 00000020:00000080:3.0:1789130736.153728:0:23515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x76b2fec9b05097c9 00000004:00100000:3.0:1789130736.153745:0:23515:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789130736.153780:0:23515:0:(import.c:65:import_set_state_nolock()) ffff9e9b83210000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130736.153864:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876038857806080:12345-0@lo:38:llog_process_th.0 Request processed in 250us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.153873:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789130736.153918:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b84921a40 x1876038857806080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130736.153930:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130736.153939:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789130736.153948:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789130736.153952:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789130736.153955:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c834fc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789130736.153961:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876038857806080:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789130736.153981:0:25858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789130736.162331:0:25858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789130736.162739:0:25844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789130736.162766:0:25844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789130736.162789:0:25844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94400/0x76b2fec9b0509798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050979f expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130736.162813:0:25844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb94400/0x76b2fec9b0509798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b050979f expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789130736.162871:0:25844:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789130736.162874:0:25844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789130736.162876:0:25844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130736.162877:0:25844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130736.162878:0:25844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130736.162879:0:25844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130736.162881:0:25844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130736.162883:0:25844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130736.162884:0:25844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130736.162888:0:25844:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789130736.162891:0:25844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130736.162893:0:25844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789130736.162894:0:25844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130736.162895:0:25844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130736.162895:0:25844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130736.162897:0:25844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130736.162898:0:25844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130736.162898:0:25844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130736.162899:0:25844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130736.162927:0:25844:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789130736.162949:0:25844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857806208:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789130736.163026:0:25844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.163068:0:25844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c86eb1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130736.163095:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857806208 00000100:00100000:3.0:1789130736.163101:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857806208 00000100:00100000:3.0:1789130736.163147:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789130736.163158:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857806208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789130736.163191:0:23508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789130736.163207:0:23508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789130736.181261:0:23508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789130736.181286:0:23508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789130736.181768:0:23531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789130736.181834:0:23531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789130736.181859:0:23531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130736.181877:0:23531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050965d expref: 24 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130736.181885:0:23531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050966b expref: 24 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130736.181906:0:23531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130736.181947:0:23531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b050966b expref: 24 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130736.181960:0:23531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b050966b expref: 24 pid: 23510 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130736.183145:0:23531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857806336:0@lo:104: 00000100:00100000:0.0:1789130736.183199:0:23531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130736.184117:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:25844:x1876038857806208:12345-0@lo:253:mount.lustre.0 Request processed in 20956us (21086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130736.184130:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789130736.184204:0:25844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:25844:1876038857806208:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789130736.184219:0:25844:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789130736.184223:0:25844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130736.184225:0:25844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789130736.184227:0:25844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130736.184228:0:25844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130736.184229:0:25844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130736.184230:0:25844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130736.184231:0:25844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130736.184233:0:25844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130736.184234:0:25844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789130736.184248:0:25844:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789130736.184892:0:23531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b050965d expref: 23 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130736.184909:0:23531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b050965d expref: 23 pid: 23508 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130736.184922:0:23531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857806464:0@lo:104: 00000100:00100000:0.0:1789130736.184963:0:23531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1789130736.190242:0:25844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789130736.192418:0:23531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b82bfb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130736.199055:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857806336 00000100:00100000:1.0:1789130736.199132:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857806336 00000100:00100000:1.0:1789130736.199190:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857806464 00000100:00100000:1.0:1789130736.199193:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857806464 00000100:00100000:1.0:1789130736.199209:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130736.199218:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:23531:x1876038857806336:12345-0@lo:104: 00010000:00010000:1.0:1789130736.199239:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.199355:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789130736.199362:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:23531:x1876038857806336:12345-0@lo:104: Request processed in 145us (16164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130736.199370:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130736.199399:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130736.199405:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:23531:x1876038857806464:12345-0@lo:104: 00010000:00010000:1.0:1789130736.199413:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.199448:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789130736.199454:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:23531:x1876038857806464:12345-0@lo:104: Request processed in 50us (14491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130736.199460:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789130736.200870:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130736.200884:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.200895:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6a200 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130736.200900:0:25545:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.200909:0:25545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130736.200918:0:25545:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130736.200924:0:25545:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130736.201853:0:25545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.201864:0:25545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130736.201895:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.201902:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6a200/0x76b2fec9b050966b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509672 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.201918:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130736.201922:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.201927:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9cb4e6bc00 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130736.201931:0:25545:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.201938:0:25545:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130736.201944:0:25545:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130736.201949:0:25545:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130736.201965:0:25545:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.201970:0:25545:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789130736.202886:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3645:1876038857806592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130736.202957:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130736.203397:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.203423:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9cb4e6bc00/0x76b2fec9b050965d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509664 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.203442:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130736.203444:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130736.203446:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130736.203453:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130736.203872:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857806592 00000100:00100000:2.0:1789130736.203881:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857806592 00010000:00010000:2.0:1789130736.203912:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050966b expref: 24 pid: 23510 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130736.203956:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130736.203964:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94513840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3645:x1876038857806592:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130736.204848:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130736.204869:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857806720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130736.204940:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130736.205171:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130736.205182:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050966b expref: 24 pid: 23510 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205198:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b050966b expref: 24 pid: 23510 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205222:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130736.205263:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94513840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3645:x1876038857806592:12345-0@lo:103:ldlm_bl.0 Request processed in 1300us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130736.205274:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130736.205297:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857806720 00000100:00100000:2.0:1789130736.205303:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857806720 00010000:00010000:2.0:1789130736.205327:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050965d expref: 24 pid: 23508 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130736.205344:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130736.205351:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c98da7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3643:x1876038857806720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130736.205360:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130736.205364:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050965d expref: 24 pid: 23508 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205373:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b050965d expref: 24 pid: 23508 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205395:0:23500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205415:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789130736.205431:0:23500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.023657909s 00010000:00010000:2.0:1789130736.205437:0:23500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205445:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205453:0:23500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205459:0:23500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.205466:0:23500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130736.206637:0:23500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.206653:0:23500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.206667:0:23500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130736.206680:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130736.206751:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c98da7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3643:x1876038857806720:12345-0@lo:103:ldlm_bl.0 Request processed in 1397us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130736.206760:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130736.206968:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c82589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3645:1876038857806592:0@lo:103:ldlm_bl.0 00002000:00080000:2.0:1789130736.207061:0:25844:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789130736.207534:0:25844:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789130736.207579:0:25844:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789130736.207720:0:25844:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789130736.207745:0:25844:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789130736.207770:0:25844:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789130736.212242:0:25844:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1789130736.213769:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857806720:0@lo:103:ldlm_bl.0 00000020:00000004:2.0:1789130736.214564:0:25844:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789130736.214933:0:23531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83a93400/0x76b2fec9b0509672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b050966b expref: 23 pid: 23510 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130736.214951:0:23531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857806336:0@lo:104: 00010000:00010000:1.0:1789130736.214964:0:23531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b0509664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b050965d expref: 22 pid: 23508 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130736.214989:0:23531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23531:1876038857806464:0@lo:104: 00010000:00010000:1.0:1789130736.215010:0:23531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.215023:0:23531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.215029:0:23531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130736.215054:0:23531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c829d9200/0x76b2fec9b05097d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130736.345598:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130736.345668:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857806848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130736.345766:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130736.345807:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857806848 00000100:00100000:1.0:1789130736.345815:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857806848 00000100:00100000:1.0:1789130736.345878:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130736.345890:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857806848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130736.345916:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789130736.345970:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857806848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130736.345978:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130736.346028:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857806848:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130737.049485:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130737.370588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857806976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130737.370683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130737.370740:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857806976 00000100:00100000:2.0:1789130737.370747:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857806976 00000100:00100000:2.0:1789130737.370790:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130737.370798:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c945130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857806976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130737.370831:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789130737.370870:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c945130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857806976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130737.370877:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130737.370922:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857806976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130737.371195:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130737.371205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857807104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130737.371234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130737.371292:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857807104 00000100:00100000:3.0:1789130737.371297:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857807104 00000100:00100000:3.0:1789130737.371330:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789130737.371337:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857807104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789130737.371352:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789130737.371399:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857807104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130737.371405:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130737.371463:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857807104:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1789130737.381359:0:25914:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130737.381588:0:25914:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789130737.497284:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789130737.689774:0:23512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789130737.689784:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9b82102800 from 14 10000000:01000000:1.0:1789130737.689791:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789130737.689846:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83982400/0x76b2fec9b05097d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130737.689859:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83982400/0x76b2fec9b05097d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130737.689871:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83982400/0x76b2fec9b05097d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130737.689899:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857807232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130737.689983:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130737.690038:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c90f2f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130737.690151:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857807232 00000100:00100000:3.0:1789130737.690159:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857807232 00000100:00100000:3.0:1789130737.690218:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789130737.690228:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:23512:x1876038857807232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130737.690242:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130737.690264:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05097de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05097d7 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130737.690290:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05097de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05097d7 expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130737.690301:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb95200/0x76b2fec9b05097de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05097d7 expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130737.690311:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb95200, rc 0) 00000100:00100000:3.0:1789130737.690358:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857807232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130737.690376:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789130737.696502:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857807232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130737.696539:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83982400/0x76b2fec9b05097d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05097de expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130737.696554:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83982400/0x76b2fec9b05097d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05097de expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130737.696647:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857807360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789130737.696724:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130737.696774:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c90f2f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130737.697982:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857807360 00000100:00100000:3.0:1789130737.697995:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857807360 00000100:00100000:3.0:1789130737.698069:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789130737.698080:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857807360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789130737.698107:0:23508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789130737.698127:0:23508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789130737.698130:0:23508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789130737.698247:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857807360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 168us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130737.698256:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789130737.698356:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857807360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789130737.698436:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789130737.698448:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83982400/0x76b2fec9b05097d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05097de expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130737.698458:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83982400/0x76b2fec9b05097d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05097de expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130737.698469:0:23512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789130737.698472:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e9cb353d000 from 14 10000000:01000000:1.0:1789130737.698475:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789130737.698507:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b05097e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130737.698515:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b05097e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130737.698523:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b05097e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130737.698549:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857807488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130737.698579:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130737.698635:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c90f2f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130737.698691:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857807488 00000100:00100000:3.0:1789130737.698695:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857807488 00000100:00100000:3.0:1789130737.698728:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130737.698735:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857807488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130737.698744:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130737.698758:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b05097ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05097e5 expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130737.698786:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b05097ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05097e5 expref: 24 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130737.698796:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c9fb95a00/0x76b2fec9b05097ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05097e5 expref: 24 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130737.698806:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c9fb95a00, rc 0) 00000100:00100000:3.0:1789130737.698834:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:23512:x1876038857807488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130737.698840:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789130737.698903:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857807488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130737.698915:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b05097e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05097ec expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130737.698925:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b05097e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05097ec expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130737.698963:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857807616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789130737.698991:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130737.699018:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c90f2f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130737.699054:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857807616 00000100:00100000:3.0:1789130737.699058:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857807616 00000100:00100000:3.0:1789130737.699089:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130737.699095:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9433ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:23512:x1876038857807616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789130737.699106:0:23509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789130737.699119:0:23509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789130737.699122:0:23509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789130737.699182:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9433ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:23512:x1876038857807616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130737.699189:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789130737.699253:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857807616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789130737.699294:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789130737.699300:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b05097e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05097ec expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130737.699307:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b83982600/0x76b2fec9b05097e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05097ec expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130738.073875:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130739.097392:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130740.121747:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130740.442767:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130740.442792:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857807744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130740.442865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130740.442971:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857807744 00000100:00100000:1.0:1789130740.442980:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857807744 00000100:00100000:1.0:1789130740.443053:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130740.443065:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84922580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857807744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130740.443119:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789130740.443170:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84922580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857807744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130740.443177:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130740.443265:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857807744:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789130740.443334:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130741.144866:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130741.465059:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857807872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130741.465134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130741.465210:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857807872 00000100:00100000:1.0:1789130741.465746:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857807872 00000100:00100000:1.0:1789130741.465810:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789130741.465820:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857807872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130741.465844:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789130741.465895:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857807872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130741.465904:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789130741.465926:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130741.465966:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857807872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130741.466029:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857808000:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.466063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130741.466097:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857808000 00000100:00100000:1.0:1789130741.466101:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857808000 00000100:00100000:1.0:1789130741.466126:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789130741.466132:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3644:x1876038857808000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.466163:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3644:x1876038857808000:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130741.466170:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789130741.466211:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857808000:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.472490:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1789130741.472503:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130741.472508:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789130741.472512:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789130741.472517:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857808128:0@lo:400:kworker.0 00000100:00080000:0.0:1789130741.472519:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 754 00000100:00080000:0.0:1789130741.472523:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789130741.472530:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e9c9fa54800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130741.472554:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb4ea30c0 x1876038857808384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130741.472577:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857808384:0@lo:8:kworker.0 00000100:00100000:1.0:1789130741.472594:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130741.472610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789130741.472678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789130741.472681:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789130741.472683:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789130741.472687:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 754 00000100:00080000:0.0:1789130741.472689:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789130741.472693:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e9b82105000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1789130741.472706:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e9cb359d680 x1876038857808768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130741.472726:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857808768:0@lo:8:kworker.0 00000100:00100000:0.0:1789130741.472751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130741.472796:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857808128 00000100:00100000:1.0:1789130741.472803:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857808128 00000100:00100000:1.0:1789130741.472856:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130741.472865:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857808128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.472916:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857808128:12345-0@lo:400:kworker.0 Request processed in 52us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130741.472922:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130741.472947:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876038857808512:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.472980:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130741.473000:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876038857809152:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473023:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130741.473044:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789130741.473050:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857808256:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473069:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130741.473094:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876038857809024:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130741.473138:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857808512 00000100:00100000:1.0:1789130741.473141:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857808512 00000100:00100000:1.0:1789130741.473161:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857809152 00000100:00100000:1.0:1789130741.473163:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857809152 00000100:00100000:1.0:1789130741.473185:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857809024 00000100:00100000:1.0:1789130741.473188:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857809024 00000100:00100000:1.0:1789130741.473202:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130741.473216:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876038857808512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473249:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876038857808512:12345-0@lo:400:kworker.0 Request processed in 34us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130741.473256:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130741.473267:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130741.473273:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876038857809152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473296:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876038857809152:12345-0@lo:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130741.473303:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130741.473312:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789130741.473317:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83ae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876038857809024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473352:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83ae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876038857809024:12345-0@lo:400:kworker.0 Request processed in 34us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130741.473359:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789130741.473383:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130741.473387:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130741.473397:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857808640:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130741.473437:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876038857809280:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130741.473609:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876038857808896:0@lo:400:kworker.0 00000100:00100000:0.0:1789130741.473688:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857808384 00000100:00100000:0.0:1789130741.473694:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857808384 00000100:00100000:0.0:1789130741.473719:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857808768 00000100:00100000:0.0:1789130741.473722:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857808768 00000100:00100000:0.0:1789130741.473728:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857808256 00000100:00100000:0.0:1789130741.473731:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857808256 00000100:00100000:0.0:1789130741.473746:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130741.473751:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857808256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473774:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857808128:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.473804:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857808640 00000100:00100000:1.0:1789130741.473807:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857808640 00000100:00100000:1.0:1789130741.473829:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130741.473835:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857808640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130741.474024:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130741.474031:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876038857808384:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789130741.474059:0:25026:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:2.0:1789130741.474118:0:25026:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76b2fec9b05097f3 00002000:00100000:2.0:1789130741.474132:0:25026:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e9cabd07800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789130741.474144:0:25026:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789130741.474146:0:25026:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789130741.474319:0:25026:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789130741.474359:0:25026:0:(import.c:65:import_set_state_nolock()) ffff9e9cabd06800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130741.474503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130741.474532:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857809408:0@lo:400:kworker.0 00000100:00100000:3.0:1789130741.474555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130741.474583:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857809280 00000100:00100000:3.0:1789130741.474587:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857809280 00000100:00100000:3.0:1789130741.474632:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857808896 00000100:00100000:3.0:1789130741.474636:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857808896 00000100:00100000:3.0:1789130741.474648:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857809408 00000100:00100000:3.0:1789130741.474650:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857809408 00000100:00100000:3.0:1789130741.474677:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130741.474683:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876038857809280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130741.474720:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876038857809280:12345-0@lo:400:kworker.0 Request processed in 37us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130741.474727:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130741.474741:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130741.474747:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b849212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876038857808896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130741.474776:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b849212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876038857808896:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130741.474782:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130741.474794:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130741.474800:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84921a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876038857809408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130741.474825:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84921a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876038857809408:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130741.474830:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789130741.474848:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130741.474851:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789130741.474870:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb359da40 x1876038857808896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130741.474890:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876038857808896:0@lo:400:kworker.0 00010000:00080000:3.0:1789130741.474901:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b848d52c0 x1876038857809408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130741.474909:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857809408:0@lo:400:kworker.0 00010000:00080000:3.0:1789130741.474938:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b848d6d00 x1876038857809280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130741.474946:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876038857809280:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.475228:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857808640:12345-0@lo:400:kworker.0 Request processed in 1391us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130741.475237:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789130741.475287:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b848d61c0 x1876038857809024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130741.475298:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876038857809024:0@lo:400:kworker.0 00010000:00080000:1.0:1789130741.475311:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb4ea1a40 x1876038857808512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130741.475319:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876038857808512:0@lo:400:kworker.0 00010000:00080000:1.0:1789130741.475343:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b848d4000 x1876038857809152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130741.475351:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876038857809152:0@lo:400:kworker.0 00000100:00100000:3.0:1789130741.476204:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857808640:0@lo:400:kworker.0 00000100:00100000:3.0:1789130741.476737:0:25029:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789130741.476749:0:25029:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789130741.476968:0:25029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130741.476977:0:25029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1876038857808768:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789130741.477017:0:25029:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:3.0:1789130741.477043:0:25029:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76b2fec9b05097fa 00002000:00100000:3.0:1789130741.477059:0:25029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e9b83212000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789130741.477064:0:25029:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789130741.477067:0:25029:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789130741.477131:0:25029:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789130741.477157:0:25029:0:(import.c:65:import_set_state_nolock()) ffff9e9b83215800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130741.477242:0:25029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1876038857808768:12345-0@lo:8:kworker.0 Request processed in 264us (4488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130741.477250:0:25029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130741.482606:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857808256:12345-0@lo:400:kworker.0 Request processed in 8841us (9522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130741.482635:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789130741.482702:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb359d680 x1876038857808768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130741.482715:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130741.482726:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789130741.482735:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789130741.482741:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789130741.482745:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9b82105000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789130741.483352:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789130741.483363:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876038857808768:0@lo:8:kworker.0 00000004:00080000:0.0:1789130741.483436:0:24264:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789130741.483457:0:24264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24264:1876038857809664:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789130741.483500:0:24264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130741.483527:0:24264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c82adff00 going to sleep for 11 seconds 00000004:00080000:0.0:1789130741.483543:0:24263:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789130741.483625:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857808256:0@lo:400:kworker.0 00000100:00100000:1.0:1789130741.483644:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130741.483651:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857809536:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1789130741.483662:0:24263:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 760306048273ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789130741.483669:0:24263:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789130741.483691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130741.483694:0:25029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857809664 00000100:00100000:0.0:1789130741.483700:0:25029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857809664 00000100:00100000:1.0:1789130741.483716:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857809536 00000100:00100000:1.0:1789130741.483719:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857809536 00000100:00100000:1.0:1789130741.483742:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130741.483742:0:25029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789130741.483749:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876038857809536:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130741.483753:0:25029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:24264:x1876038857809664:12345-0@lo:7:osp-pre-1-1.0 00002000:00000024:1.0:1789130741.483775:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789130741.483817:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876038857809536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130741.483833:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789130741.483863:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b848d43c0 x1876038857809536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130741.483877:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857809536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130741.484784:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876038857808384:12345-0@lo:8:kworker.0 Request processed in 10747us (12167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130741.484793:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789130741.486676:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb4ea30c0 x1876038857808384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130741.486692:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130741.486703:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789130741.486712:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789130741.486718:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789130741.486722:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9e9c9fa54800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789130741.486748:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789130741.486754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876038857808384:0@lo:8:kworker.0 00000004:00080000:3.0:1789130741.486966:0:23542:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789130741.486998:0:23542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23542:1876038857809920:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789130741.487057:0:23542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130741.487081:0:23542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c836e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130741.487093:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130741.487101:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857809792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130741.487128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130741.487158:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857809920 00000100:00100000:3.0:1789130741.487164:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857809920 00000100:00100000:3.0:1789130741.487213:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130741.487222:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23542:x1876038857809920:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789130741.487396:0:23541:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789130741.487553:0:23541:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760309939114ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789130741.487561:0:23541:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1789130741.487684:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789130741.489837:0:23495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789130741.490883:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857809792 00000100:00100000:3.0:1789130741.490895:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857809792 00000100:00100000:3.0:1789130741.490952:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130741.490963:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3492940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876038857809792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130741.490991:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130741.491077:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3492940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876038857809792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (3948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130741.491084:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789130741.491135:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b84923480 x1876038857809792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130741.491156:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b84923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857809792:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1789130741.495814:0:25342:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789130741.495827:0:25342:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1789130741.495834:0:25342:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00002000:00080000:3.0:1789130741.507577:0:25029:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789130741.507591:0:25029:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789130741.507811:0:25029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24264:x1876038857809664:12345-0@lo:7:osp-pre-1-1.0 Request processed in 24051us (24305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130741.507824:0:25029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789130741.508259:0:24264:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b848d5680 x1876038857809664/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789130757 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130741.508277:0:24264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24264:1876038857809664:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789130741.508293:0:24264:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789130741.508827:0:24264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24264:1876038857810048:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789130741.509609:0:24264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130741.513843:0:24264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b820489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130741.513876:0:26092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857810048 00000100:00100000:2.0:1789130741.513885:0:26092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857810048 00000100:00100000:2.0:1789130741.513943:0:26092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789130741.513953:0:26092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:24264:x1876038857810048:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789130741.513992:0:26092:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1789130741.514059:0:26092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:24264:x1876038857810048:12345-0@lo:5:osp-pre-1-1.0 Request processed in 107us (4452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130741.514067:0:26092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789130741.514109:0:24264:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9c94511a40 x1876038857810048/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130757 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130741.514140:0:24264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24264:1876038857810048:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789130741.514153:0:24264:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789130741.514201:0:24264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24264:1876038857810176:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789130741.514236:0:24264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130741.514258:0:24264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b820489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130741.515867:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857810176 00000100:00100000:2.0:1789130741.515885:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857810176 00000100:00100000:2.0:1789130741.515953:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789130741.515961:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c945112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24264:x1876038857810176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789130741.516009:0:25028:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1789130741.527994:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130741.528005:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528023:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=760s v=(0 0) 00010000:00010000:0.0:1789130741.528027:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130741.528034:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528051:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528060:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528068:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528085:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.528095:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.528101:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528119:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8000 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.528123:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528133:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528151:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528158:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509801 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528177:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.528179:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.528181:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130741.528699:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130741.528706:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528715:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=760s v=(0 0) 00010000:00010000:0.0:1789130741.528718:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130741.528722:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528730:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528744:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528750:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528931:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.528942:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.528946:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528954:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.528957:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528966:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528978:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528986:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074b0b357/0x76b2fec9b0509808 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.528999:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.529007:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.529008:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130741.529279:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130741.529284:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529294:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=760s v=(0 0) 00010000:00010000:0.0:1789130741.529297:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130741.529302:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529310:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529318:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529324:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529354:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.529363:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.529367:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529374:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8c00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.529377:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529396:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529408:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529416:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b050980f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.529493:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.529495:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.529497:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789130741.531342:0:24253:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1789130741.535019:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130741.535035:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535054:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=760s v=(0 0) 00010000:00010000:0.0:1789130741.535060:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130741.535067:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535083:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535092:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535107:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535130:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789130741.535650:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130741.535656:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535666:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=760s v=(0 0) 00010000:00010000:0.0:1789130741.535669:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130741.535673:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535683:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535691:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535698:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535712:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789130741.535722:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130741.535728:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.535743:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8000 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.535747:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.536400:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.536405:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130741.536416:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.536427:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:3.0:1789130741.536440:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.536442:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.536460:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.536460:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b81f64/0x76b2fec9b0509816 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.536493:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.536495:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.536499:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.536502:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.536507:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6b17465/0x76b2fec9b050981d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.536528:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.536531:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.536533:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130741.537054:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130741.537061:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537072:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=760s v=(0 0) 00010000:00010000:0.0:1789130741.537076:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130741.537081:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537091:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537106:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537112:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537127:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.537136:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.537140:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537147:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.537150:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537158:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537171:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537179:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e27aa37/0x76b2fec9b0509824 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.537194:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.537201:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.537203:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789130741.539016:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130741.539029:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.539043:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=760s v=(0 0) 00010000:00010000:0.0:1789130741.539047:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130741.539052:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.539065:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.539075:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.539082:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.539130:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789130741.543713:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789130741.543728:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.543747:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=760s v=(0 0) 00010000:00010000:0.0:1789130741.543751:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130741.543758:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.543786:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.543798:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.543806:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.549262:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130741.549277:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.549293:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8e00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.549299:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.549312:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.549351:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.549367:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3363bf9/0x76b2fec9b050982b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.553865:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130741.553963:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130741.553974:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.553988:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8c00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.553993:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.554008:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.554034:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.554043:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad89ea2/0x76b2fec9b0509832 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.554070:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.554072:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.554074:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130741.555396:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130741.555407:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.555431:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=760s v=(0 0) 00010000:00010000:1.0:1789130741.555436:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130741.555443:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.555456:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.555466:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.557551:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.557598:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.559476:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.559489:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.559503:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.559508:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.559521:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.559549:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.559557:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063061acf/0x76b2fec9b0509839 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.559588:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.559590:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.559591:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130741.561338:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130741.561352:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.561370:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=760s v=(0 0) 00010000:00010000:1.0:1789130741.561375:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130741.561383:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.561399:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.561439:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.561446:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.561484:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.561512:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.561519:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.561527:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982a00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.561532:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.561540:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.561555:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.561562:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509840 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.561580:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.561582:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.561584:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.561767:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.561770:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.561771:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789130741.564597:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789130741.564608:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.564644:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=760s v=(0 0) 00010000:00010000:1.0:1789130741.565062:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130741.565072:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.565089:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.565102:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.565111:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.565142:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.570347:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.570364:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.570392:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982e00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.570397:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.570408:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.571569:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.571585:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006424de00/0x76b2fec9b0509847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.571624:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.571627:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.571629:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130741.572569:0:25845:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1789130741.572594:0:25845:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789130741.572598:0:25845:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789130741.591884:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c945112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:24264:x1876038857810176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 75916us (77640us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789130741.591898:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789130741.592055:0:24264:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789130741.592065:0:24264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24264:1876038857810176:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789130741.592081:0:24264:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789130741.592129:0:24264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24264:1876038857810304:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789130741.592166:0:24264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130741.592200:0:24264:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b820489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130741.592257:0:23526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857810304 00000100:00100000:0.0:1789130741.592264:0:23526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857810304 00000100:00100000:0.0:1789130741.592348:0:23526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130741.592358:0:23526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94512580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24264:x1876038857810304:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789130741.592412:0:23526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94512580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24264:x1876038857810304:12345-0@lo:900:osp-pre-1-1.0 Request processed in 57us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130741.592418:0:23526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789130741.593144:0:24264:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9c94511a40 x1876038857810304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789130757 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130741.593158:0:24264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24264:1876038857810304:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1789130741.596186:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.596202:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.596221:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.596225:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.596232:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.596262:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.596274:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.596281:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.596837:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789130741.604160:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.604175:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.604193:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.604198:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.604204:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.604219:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.604228:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.604247:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604420:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130741.604430:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604438:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.604443:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604453:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604473:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604481:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce04a396/0x76b2fec9b050984e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604501:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.604504:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604510:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402ee00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.604513:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604527:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604538:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.604545:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.604547:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.604548:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.615518:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.616174:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789130741.616188:0:25342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509855 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789130741.618322:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.618344:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.618361:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.618366:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.618372:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.618388:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.618398:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.620937:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.620990:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130741.621376:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130741.621387:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.621397:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402ea00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.621404:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.621416:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.621440:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.621448:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f27a2f2/0x76b2fec9b050985c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.621472:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.621474:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.621476:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.621894:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.622031:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622044:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.622049:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.622056:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622134:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622145:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622152:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622176:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130741.622363:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130741.622370:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.622379:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402fa00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.622382:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.622390:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.622402:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.622409:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f2e503b/0x76b2fec9b0509863 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.622425:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.622427:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.622429:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.622820:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.622828:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622838:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.622849:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.622854:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622865:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622873:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622880:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.622963:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789130741.623544:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.623551:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.623560:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.623563:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.623567:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.623577:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.623586:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.623601:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624222:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789130741.624237:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789130741.624243:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624253:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402f800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:3.0:1789130741.624256:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624267:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624530:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624541:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b050986a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624561:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130741.624565:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624585:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402f600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:3.0:1789130741.624588:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624596:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.624991:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.625003:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b0509871 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.625020:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.625022:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.625024:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.626591:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.626602:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.626811:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.626816:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.626822:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.626837:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.626855:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.626862:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.626887:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789130741.628273:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130741.628403:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130741.628417:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.628448:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e000 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130741.628453:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.628464:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.628487:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.628496:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e53dddf/0x76b2fec9b0509878 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.628519:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.628521:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.628523:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.628678:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.628914:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.628929:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.628935:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.628941:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.628958:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.628970:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.628980:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.629035:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130741.629364:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130741.629370:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.629378:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402fc00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130741.629382:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.629403:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.629416:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.629424:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf49444/0x76b2fec9b050987f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.629443:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.629445:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.629447:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.632913:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.632928:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.632945:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.632950:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.632956:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.632970:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.632982:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.632991:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.633016:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789130741.633374:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130741.633383:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.633392:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402ee00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:2.0:1789130741.633397:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.633406:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.633425:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.633452:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf7ec018/0x76b2fec9b0509886 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.633476:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.633477:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.633479:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.634344:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.634354:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.634366:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.634377:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.634383:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.634396:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.635006:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.635017:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.635045:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.636651:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.636663:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.636676:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402f400 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.636680:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.636691:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.636712:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.636720:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d856cba/0x76b2fec9b050988d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.636760:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.636762:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.636763:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.637087:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.637095:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.637107:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.637112:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.637117:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.637130:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.637141:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.637156:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.637197:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.637358:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.637364:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.637371:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.637375:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.637382:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.637394:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.637401:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006059e6e0/0x76b2fec9b0509894 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.637415:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.637417:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.637418:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.638986:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.638999:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.639013:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.639016:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.639021:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.639033:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.639043:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.639050:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.639069:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789130741.642175:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.642189:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.642220:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.642225:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.642233:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.642248:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.642259:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.642267:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.642295:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789130741.643414:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130741.643426:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643437:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e400 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.643442:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643471:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643491:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643499:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000989c3326/0x76b2fec9b050989b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643525:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130741.643530:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643536:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402fe00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.643539:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643547:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643558:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643566:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095eb25cf/0x76b2fec9b05098a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.643595:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.643598:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.643600:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130741.643708:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.643846:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.643853:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.643864:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.643868:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.643874:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.643887:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.643909:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.643917:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.643940:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789130741.643953:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.643960:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.643981:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402f200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.643984:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.643993:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.644006:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.644015:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022666d7b/0x76b2fec9b05098a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.644032:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.644034:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.644036:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.644968:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.644980:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.644991:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.644995:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.645000:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.645013:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.645023:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.645031:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.645058:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130741.645922:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130741.645932:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.645944:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.645950:0:23504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.645960:0:23504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.645977:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.645984:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e07aba30/0x76b2fec9b05098b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.646005:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.646008:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.646010:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789130741.646792:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.646801:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.646813:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.646817:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.646822:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.646835:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.646844:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.646852:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.646874:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789130741.648179:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.648191:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.648204:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.648217:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.648223:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.648235:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.648244:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.648253:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.648273:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789130741.649494:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789130741.649505:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.649517:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=760s v=(0 0) 00010000:00010000:3.0:1789130741.649521:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130741.649527:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.649540:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.649550:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.649564:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.649582:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789130741.655572:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789130741.655588:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655601:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402f600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.655606:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655767:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655799:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655808:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004af6a544/0x76b2fec9b05098b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655829:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130741.655833:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655839:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402f800 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.655842:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655848:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655857:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655864:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098bb641/0x76b2fec9b05098be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655874:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130741.655878:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655891:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402f000 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130741.655894:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655902:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655913:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655920:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9c3795/0x76b2fec9b05098c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130741.655932:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.655934:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.655936:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130741.655945:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.656404:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130741.659245:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130741.659259:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.659277:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=760s v=(0 0) 00010000:00010000:2.0:1789130741.659281:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130741.659290:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.659305:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.659315:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.659323:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.659362:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789130741.659798:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130741.659805:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.659821:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e400 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.659826:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.659836:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.659853:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.659861:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c1a380/0x76b2fec9b05098cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130741.659879:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.659881:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130741.659883:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789130741.660021:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130741.660028:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660038:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=760s v=(0 0) 00010000:00010000:2.0:1789130741.660042:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130741.660048:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660058:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660068:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660076:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660088:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789130741.660391:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789130741.660398:0:25342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660407:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=760s v=(0 0) 00010000:00010000:2.0:1789130741.660411:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130741.660475:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660499:0:25342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660508:0:25342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660517:0:25342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130741.660570:0:25342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1789130741.660841:0:25342:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1789130741.660946:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:23542:x1876038857809920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 173720us (173884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130741.660957:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130741.661025:0:23542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb359d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23542:1876038857809920:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789130741.661044:0:23542:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789130741.661093:0:23542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23542:1876038857810432:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789130741.661130:0:23542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130741.661205:0:23542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9b84033900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130741.661242:0:26092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857810432 00000100:00100000:2.0:1789130741.661248:0:26092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857810432 00000100:00100000:2.0:1789130741.661348:0:26092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789130741.661358:0:26092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:23542:x1876038857810432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789130741.661394:0:26092:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1789130741.665544:0:26092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:23542:x1876038857810432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4179us (4405us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789130741.665558:0:26092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789130741.666638:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789130741.666653:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666667:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e000 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:3.0:1789130741.666672:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666685:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666707:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666716:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d62e277/0x76b2fec9b05098d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666757:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130741.666761:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666768:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f000 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130741.666771:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.666773:0:23503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666782:0:23503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666792:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666799:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df0121e2/0x76b2fec9b05098da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130741.666811:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.666813:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130741.666815:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130741.666981:0:23542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb34921c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23542:1876038857810432:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789130741.666999:0:23542:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1789130742.184038:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130742.489670:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130742.489693:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857810560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130742.489762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130742.489820:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857810560 00000100:00100000:0.0:1789130742.489828:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857810560 00000100:00100000:0.0:1789130742.489898:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789130742.489907:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857810560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130742.489938:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789130742.489996:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857810560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130742.490003:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789130742.490049:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857810560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130742.490598:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130742.490633:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857810688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130742.490678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130742.490992:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857810688 00000100:00100000:0.0:1789130742.490998:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857810688 00000100:00100000:0.0:1789130742.491036:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130742.491043:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94511680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857810688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130742.491065:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789130742.491100:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94511680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857810688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130742.491107:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789130742.491174:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857810688:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789130743.197386:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789130743.642079:0:24277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1789130743.724601:0:26204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789130744.216863:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789130744.876230:0:26257:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130744.876464:0:26257:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789130745.241130:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130745.562798:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130745.562819:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857810816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130745.562885:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130745.562958:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857810816 00000100:00100000:2.0:1789130745.562965:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857810816 00000100:00100000:2.0:1789130745.563033:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789130745.563042:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857810816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130745.563072:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789130745.563117:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857810816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130745.563124:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789130745.563173:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857810816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789130745.567505:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1789130745.840334:0:26307:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130745.840766:0:26307:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789130746.147053:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130746.147151:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834612224 00000100:00100000:1.0:1789130746.147160:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834612224 00000100:00100000:1.0:1789130746.147216:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 116 00000100:00100000:1.0:1789130746.147225:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1876038834612224:12345-192.168.202.10@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789130746.147257:0:23510:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from d1208214-416c-40c9-b997-874a76bc0c4a@192.168.202.10@tcp t0 exp 0000000000000000 cur 764 last 0 00000020:00000080:1.0:1789130746.147296:0:23510:0:(genops.c:1385:class_connect()) connect: client d1208214-416c-40c9-b997-874a76bc0c4a, cookie 0x76b2fec9b05098e1 00000100:00080000:1.0:1789130746.147581:0:23510:0:(import.c:65:import_set_state_nolock()) ffff9e9b8480e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130746.148095:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+5:2398:x1876038834612224:12345-192.168.202.10@tcp:250:mount.lustre.0 Request processed in 865us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130746.148110:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 116 00000100:00100000:1.0:1789130746.157425:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.157547:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834612352 00000100:00100000:3.0:1789130746.157559:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834612352 00000100:00100000:3.0:1789130746.157825:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 117 00000100:00100000:3.0:1789130746.157836:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+5:18408:x1876038834612352:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789130746.157854:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130746.157874:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b8402f000/0x76b2fec9b05098e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14cb7 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130746.157902:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b8402f000/0x76b2fec9b05098e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cb7 expref: 6 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130746.157914:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b8402f000/0x76b2fec9b05098e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cb7 expref: 6 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130746.157923:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b8402f000, rc 0) 00000100:00100000:3.0:1789130746.157972:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+6:18408:x1876038834612352:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 137us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.157979:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 117 00000100:00100000:0.0:1789130746.164044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130746.164182:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834612480 00000100:00100000:1.0:1789130746.164194:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834612480 00000100:00100000:1.0:1789130746.164328:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 118 00000100:00100000:1.0:1789130746.164341:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+6:18408:x1876038834612480:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789130746.164505:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+6:18408:x1876038834612480:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 167us (474us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130746.164514:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 118 00000100:00100000:0.0:1789130746.168506:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.168657:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834612608 00000100:00100000:3.0:1789130746.168667:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834612608 00000100:00100000:3.0:1789130746.168724:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 119 00000100:00100000:3.0:1789130746.168734:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+6:18408:x1876038834612608:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789130746.168754:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130746.168772:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b8402ec00/0x76b2fec9b05098ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14cbe expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130746.168802:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b8402ec00/0x76b2fec9b05098ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cbe expref: 7 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130746.168815:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b8402ec00/0x76b2fec9b05098ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cbe expref: 7 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130746.168839:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b8402ec00, rc 0) 00000100:00100000:3.0:1789130746.168901:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+7:18408:x1876038834612608:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 169us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.168909:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 119 00000100:00100000:3.0:1789130746.172256:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130746.173299:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834612736 00000100:00100000:1.0:1789130746.173312:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834612736 00000100:00100000:1.0:1789130746.173385:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 120 00000100:00100000:1.0:1789130746.173396:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+7:18408:x1876038834612736:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789130746.173880:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+8:18408:x1876038834612736:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 485us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130746.173889:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 120 00000100:00100000:0.0:1789130746.181715:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130746.181820:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834612864 00000100:00100000:2.0:1789130746.181832:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834612864 00000100:00100000:2.0:1789130746.181899:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 121 00000100:00100000:2.0:1789130746.181910:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+8:18408:x1876038834612864:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789130746.182082:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+8:18408:x1876038834612864:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 173us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.182090:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 121 00000100:00100000:1.0:1789130746.193252:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.193799:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834612992 00000100:00100000:3.0:1789130746.193810:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834612992 00000100:00100000:3.0:1789130746.193909:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:3.0:1789130746.193920:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac763450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+8:18427:x1876038834612992:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130746.194076:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac763450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+8:18427:x1876038834612992:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 157us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.194084:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:1.0:1789130746.223958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.224054:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834613120 00000100:00100000:3.0:1789130746.224066:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834613120 00000100:00100000:3.0:1789130746.224125:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 123 00000100:00100000:3.0:1789130746.224136:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+8:18427:x1876038834613120:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130746.224307:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+8:18427:x1876038834613120:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 172us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.224315:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 123 00000100:00100000:0.0:1789130746.228708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.229040:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834613248 00000100:00100000:3.0:1789130746.229051:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834613248 00000100:00100000:3.0:1789130746.229099:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 124 00000100:00100000:3.0:1789130746.229108:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+8:18427:x1876038834613248:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130746.229254:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+8:18427:x1876038834613248:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 146us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.229266:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 124 00000100:00100000:1.0:1789130746.236052:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130746.236349:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834613376 00000100:00100000:2.0:1789130746.236360:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834613376 00000100:00100000:2.0:1789130746.236427:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 125 00000100:00100000:2.0:1789130746.236454:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+8:18408:x1876038834613376:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789130746.236473:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130746.236493:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c8353e800/0x76b2fec9b05098f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14cef expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.236525:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c8353e800/0x76b2fec9b05098f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cef expref: 9 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.236536:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c8353e800/0x76b2fec9b05098f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cef expref: 9 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.236545:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353e800, rc 0) 00000100:00100000:2.0:1789130746.236649:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+9:18408:x1876038834613376:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 197us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.236657:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 125 00000100:00100000:2.0:1789130746.244964:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130746.245106:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834613504 00000100:00100000:1.0:1789130746.245116:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834613504 00000100:00100000:1.0:1789130746.245173:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 126 00000100:00100000:1.0:1789130746.245185:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+9:18408:x1876038834613504:12345-192.168.202.10@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789130746.245230:0:23509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789130746.245249:0:23509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789130746.245254:0:23509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789130746.245257:0:23509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789130746.245260:0:23509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789130746.245291:0:23509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1789130746.246743:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+9:18408:x1876038834613504:12345-192.168.202.10@tcp:256:mount.lustre.0 Request processed in 1551us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130746.246757:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 126 00000100:00100000:3.0:1789130746.248862:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130746.248970:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834613632 00000100:00100000:1.0:1789130746.248981:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834613632 00000100:00100000:1.0:1789130746.249034:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 127 00000100:00100000:1.0:1789130746.249044:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+9:18408:x1876038834613632:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130746.249061:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130746.249080:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14cf6 expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130746.249111:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 10 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130746.249122:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 10 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130746.249132:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83983a00, rc 0) 00000100:00100000:1.0:1789130746.249186:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+10:18408:x1876038834613632:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 144us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130746.249194:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 127 00000100:00100000:2.0:1789130746.250544:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130746.250644:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834613760 00000100:00100000:1.0:1789130746.250663:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834613760 00000100:00100000:1.0:1789130746.250709:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 128 00000100:00100000:1.0:1789130746.250717:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+10:18408:x1876038834613760:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789130746.250858:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+10:18408:x1876038834613760:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 141us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130746.250866:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 128 00000100:00100000:0.0:1789130746.252590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130746.252708:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834613888 00000100:00100000:2.0:1789130746.252719:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834613888 00000100:00100000:2.0:1789130746.252769:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 129 00000100:00100000:2.0:1789130746.252779:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+10:18408:x1876038834613888:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789130746.252940:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+10:18408:x1876038834613888:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 160us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.252948:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 129 00000100:00100000:0.0:1789130746.257675:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.258031:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834614016 00000100:00100000:3.0:1789130746.258042:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834614016 00000100:00100000:3.0:1789130746.258104:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 130 00000100:00100000:3.0:1789130746.258115:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+10:18431:x1876038834614016:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130746.258274:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+10:18431:x1876038834614016:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 161us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.258294:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 130 00010000:00010000:1.0:1789130746.265820:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130746.268719:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130746.268974:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834614144 00000100:00100000:1.0:1789130746.268985:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834614144 00000100:00100000:1.0:1789130746.269045:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 131 00000100:00100000:1.0:1789130746.269056:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+10:18431:x1876038834614144:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130746.269244:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+10:18431:x1876038834614144:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 189us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130746.269252:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 131 00000100:00100000:0.0:1789130746.277686:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130746.277786:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130746.277961:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834614272 00000100:00100000:1.0:1789130746.277972:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834614272 00000100:00100000:1.0:1789130746.278190:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834614528 00000100:00100000:1.0:1789130746.278194:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834614528 00000100:00100000:3.0:1789130746.284392:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1789130746.284405:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1876038834614272:12345-192.168.202.10@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789130746.284446:0:23517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 886c6038-f10d-4040-94e2-570d1de9fb6a@192.168.202.10@tcp t0 exp 0000000000000000 cur 765 last 0 00000020:00000080:3.0:1789130746.284504:0:23517:0:(genops.c:1385:class_connect()) connect: client 886c6038-f10d-4040-94e2-570d1de9fb6a, cookie 0x76b2fec9b0509904 00000004:00100000:3.0:1789130746.284533:0:23517:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789130746.284762:0:23517:0:(import.c:65:import_set_state_nolock()) ffff9e9b83212800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130746.284839:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2398:x1876038834614272:12345-192.168.202.10@tcp:38:mount.lustre.0 Request processed in 433us (7162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.284849:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1789130746.284873:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:3.0:1789130746.284878:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1876038834614528:12345-192.168.202.10@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789130746.284894:0:23517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 886c6038-f10d-4040-94e2-570d1de9fb6a@192.168.202.10@tcp t0 exp 0000000000000000 cur 765 last 0 00000020:00000080:3.0:1789130746.284922:0:23517:0:(genops.c:1385:class_connect()) connect: client 886c6038-f10d-4040-94e2-570d1de9fb6a, cookie 0x76b2fec9b050990b 00000004:00100000:3.0:1789130746.284949:0:23517:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789130746.287309:0:23517:0:(import.c:65:import_set_state_nolock()) ffff9e9b83211000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130746.289568:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2398:x1876038834614528:12345-192.168.202.10@tcp:38:mount.lustre.0 Request processed in 4678us (11770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.289582:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:0.0:1789130746.307666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130746.307698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130746.307748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.307809:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834614784 00000100:00100000:3.0:1789130746.307819:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834614784 00000100:00100000:3.0:1789130746.307878:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834614656 00000100:00100000:3.0:1789130746.307881:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834614656 00000100:00100000:3.0:1789130746.307894:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834614400 00000100:00100000:3.0:1789130746.307897:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834614400 00000100:00100000:3.0:1789130746.307912:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:3.0:1789130746.307921:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+7:18408:x1876038834614784:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789130746.307961:0:23517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789130746.308055:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+7:18408:x1876038834614784:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 134us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.308063:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:3.0:1789130746.308081:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:2.0:1789130746.308086:0:23515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789130746.308088:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+6:0:x1876038834614656:12345-192.168.202.10@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789130746.308094:0:23515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00000024:3.0:1789130746.308105:0:23517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789130746.308139:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+6:0:x1876038834614656:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 52us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.308145:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:3.0:1789130746.308164:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:3.0:1789130746.308170:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+6:0:x1876038834614400:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789130746.308194:0:23517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789130746.308221:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+6:0:x1876038834614400:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 51us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.308228:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00080000:0.0:1789130746.308607:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130746.308660:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130746.317989:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130746.318091:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834614912 00000100:00100000:2.0:1789130746.318117:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834614912 00000100:00100000:2.0:1789130746.318181:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:2.0:1789130746.318190:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18408:x1876038834614912:12345-192.168.202.10@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789130746.318305:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18408:x1876038834614912:12345-192.168.202.10@tcp:40:mount.lustre.0 Request processed in 115us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.318314:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:3.0:1789130746.333544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.333589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130746.333694:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130746.333833:0:25029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834615040 00000100:00100000:0.0:1789130746.333844:0:25029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834615040 00000100:00100000:0.0:1789130746.333886:0:25029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834615168 00000100:00100000:0.0:1789130746.333889:0:25029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834615168 00000100:00100000:0.0:1789130746.333907:0:25029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:0.0:1789130746.333916:0:25029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb359d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876038834615040:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789130746.333953:0:25029:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 886c6038-f10d-4040-94e2-570d1de9fb6a@192.168.202.10@tcp t0 exp 0000000000000000 cur 765 last 0 00000100:00100000:2.0:1789130746.333961:0:23527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834615296 00000100:00100000:2.0:1789130746.333965:0:23527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834615296 00000020:00000080:0.0:1789130746.333986:0:25029:0:(genops.c:1385:class_connect()) connect: client 886c6038-f10d-4040-94e2-570d1de9fb6a, cookie 0x76b2fec9b0509912 00002000:00100000:0.0:1789130746.333997:0:25029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 886c6038-f10d-4040-94e2-570d1de9fb6a/ffff9e9cac2db000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789130746.334009:0:25029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789130746.334012:0:23527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:2.0:1789130746.334019:0:23527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb3491680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18408:x1876038834615296:12345-192.168.202.10@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789130746.334089:0:23527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb3491680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18408:x1876038834615296:12345-192.168.202.10@tcp:900:mount.lustre.0 Request processed in 72us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.334097:0:23527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 3 00002000:00080000:0.0:1789130746.334180:0:25029:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789130746.334212:0:25029:0:(import.c:65:import_set_state_nolock()) ffff9e9cac2dd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130746.334230:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:1.0:1789130746.334236:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b84923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1876038834615168:12345-192.168.202.10@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789130746.334239:0:25029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb359d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2398:x1876038834615040:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 324us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130746.334246:0:25029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00010000:00080000:1.0:1789130746.334252:0:25028:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 886c6038-f10d-4040-94e2-570d1de9fb6a@192.168.202.10@tcp t0 exp 0000000000000000 cur 765 last 0 00000020:00000080:1.0:1789130746.334272:0:25028:0:(genops.c:1385:class_connect()) connect: client 886c6038-f10d-4040-94e2-570d1de9fb6a, cookie 0x76b2fec9b0509919 00002000:00100000:1.0:1789130746.334278:0:25028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 886c6038-f10d-4040-94e2-570d1de9fb6a/ffff9e9b8480d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130746.334301:0:25028:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789130746.334427:0:25028:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789130746.334453:0:25028:0:(import.c:65:import_set_state_nolock()) ffff9e9b84809800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130746.334491:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b84923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2398:x1876038834615168:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 254us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130746.334498:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:3.0:1789130746.339721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130746.340122:0:23518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834615424 00000100:00100000:2.0:1789130746.340132:0:23518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834615424 00000100:00100000:2.0:1789130746.340189:0:23518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:2.0:1789130746.340200:0:23518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18408:x1876038834615424:12345-192.168.202.10@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789130746.355344:0:23518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15047us 00000004:00200000:3.0:1789130746.364389:0:23518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789130746.364533:0:23518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18408:x1876038834615424:12345-192.168.202.10@tcp:33:mount.lustre.0 Request processed in 24328us (24815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.364549:0:23518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:0.0:1789130746.508251:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130746.509532:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834615552 00000100:00100000:2.0:1789130746.509547:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834615552 00000100:00100000:2.0:1789130746.509696:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1789130746.509708:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18456:x1876038834615552:12345-192.168.202.10@tcp:101:mkdir.0 00010000:00010000:2.0:1789130746.509730:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130746.509757:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b0509920 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14d27 expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.509828:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509927 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.509859:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.509945:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130746.510058:0:26319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789130746.510063:0:26319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789130746.510117:0:26319:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.510143:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b0509920 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d27 expref: 8 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.510161:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509927 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d27 expref: 7 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130746.510169:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbe200) 00010000:00010000:2.0:1789130746.510172:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130746.510176:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353ea00, rc 0) 00000100:00100000:2.0:1789130746.510296:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+7:18456:x1876038834615552:12345-192.168.202.10@tcp:101:mkdir.0 Request processed in 589us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.510304:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:1.0:1789130746.584808:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130746.584829:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857810944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130746.584905:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130746.585008:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857810944 00000100:00100000:1.0:1789130746.585016:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857810944 00000100:00100000:1.0:1789130746.585070:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130746.585080:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857810944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789130746.585106:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789130746.585149:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857810944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130746.585156:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789130746.585178:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130746.585212:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857810944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130746.585776:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857811072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.585831:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.585855:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857811584:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.585880:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.585896:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4de30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876038857812096:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.585914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.585945:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789130746.585950:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857811200:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.585973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.586004:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857811712:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.586026:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.586043:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4de0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857812224:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.586063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.586094:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857811200 00000100:00100000:0.0:1789130746.586099:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857811200 00000100:00100000:0.0:1789130746.586123:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857811712 00000100:00100000:0.0:1789130746.586126:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857811712 00000100:00100000:0.0:1789130746.586139:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130746.586145:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857811200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.586190:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857811200:12345-0@lo:400:kworker.0 Request processed in 44us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130746.586198:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130746.586212:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130746.586218:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857811712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.586244:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857811712:12345-0@lo:400:kworker.0 Request processed in 27us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130746.586250:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130746.586269:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857811328:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.586333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.586351:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857811840:0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.586512:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857811456:0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.586550:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857811072 00000100:00100000:2.0:1789130746.586554:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857811072 00000100:00100000:2.0:1789130746.586582:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789130746.586589:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3644:x1876038857811072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.586647:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3644:x1876038857811072:12345-0@lo:400:kworker.0 Request processed in 59us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.586653:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789130746.586685:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857811584 00000100:00100000:2.0:1789130746.586688:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857811584 00000100:00100000:2.0:1789130746.586712:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857812096 00000100:00100000:2.0:1789130746.586715:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857812096 00000100:00100000:2.0:1789130746.586733:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857812224 00000100:00100000:2.0:1789130746.586735:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857812224 00000100:00100000:2.0:1789130746.586749:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130746.586754:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857811584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.586780:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857811584:12345-0@lo:400:kworker.0 Request processed in 26us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.586786:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130746.586794:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130746.586799:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876038857812096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.586819:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876038857812096:12345-0@lo:400:kworker.0 Request processed in 20us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.586824:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130746.586832:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789130746.586837:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857812224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.586858:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876038857812224:12345-0@lo:400:kworker.0 Request processed in 21us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.586863:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789130746.586880:0:26092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857811328 00000100:00100000:2.0:1789130746.586882:0:26092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857811328 00000100:00100000:2.0:1789130746.586906:0:26092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130746.586922:0:26092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857811328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.586952:0:26092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857811328:12345-0@lo:400:kworker.0 Request processed in 32us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130746.586959:0:26092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130746.587015:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857811200:0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.587026:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857811712:0@lo:400:kworker.0 00010000:00080000:2.0:1789130746.587038:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb4de0780 x1876038857812224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130746.587048:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4de0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876038857812224:0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.587055:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857811072:0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.587064:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857811584:0@lo:400:kworker.0 00000100:00100000:2.0:1789130746.587074:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4de30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876038857812096:0@lo:400:kworker.0 00000100:00080000:1.0:1789130746.587736:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130746.587741:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130746.588017:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130746.588034:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b8407e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857812608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130746.588077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130746.588113:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857812608 00000100:00100000:3.0:1789130746.588118:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857812608 00000100:00100000:3.0:1789130746.588156:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789130746.588163:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857812608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130746.588182:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789130746.588222:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857812608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.588228:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789130746.588264:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b8407e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857812608:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789130746.588501:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130746.588562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.588606:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876038857812352:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.588675:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.588708:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857811328:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.588732:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.588754:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876038857811968:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.588776:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.588795:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857812480:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.588819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130746.588850:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857812352 00000100:00100000:0.0:1789130746.588854:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857812352 00000100:00100000:0.0:1789130746.588886:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857811968 00000100:00100000:0.0:1789130746.588889:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857811968 00000100:00100000:0.0:1789130746.588900:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857812480 00000100:00100000:0.0:1789130746.588903:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857812480 00000100:00100000:0.0:1789130746.588922:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130746.588929:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876038857812352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.588967:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876038857812352:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130746.588973:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130746.588985:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130746.588991:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876038857811968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.589035:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876038857811968:12345-0@lo:400:kworker.0 Request processed in 44us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130746.589041:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130746.589052:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789130746.589058:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876038857812480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130746.589641:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857811840 00000100:00100000:3.0:1789130746.589647:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857811840 00000100:00100000:3.0:1789130746.589690:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857811456 00000100:00100000:3.0:1789130746.589693:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857811456 00000100:00100000:3.0:1789130746.589718:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789130746.589725:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857811840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130746.589767:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857811840:12345-0@lo:400:kworker.0 Request processed in 43us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.589774:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789130746.589785:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130746.589790:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857811456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130746.589815:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1876038857811456:12345-0@lo:400:kworker.0 Request processed in 25us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.589820:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130746.589842:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857812736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130746.589871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130746.589900:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857812736 00000100:00100000:3.0:1789130746.589903:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857812736 00000100:00100000:3.0:1789130746.589922:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789130746.589928:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876038857812736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130746.589941:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130746.589971:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876038857812736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130746.589977:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789130746.590006:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857812736:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789130746.590096:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130746.590100:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130746.590103:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130746.590138:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857811840:0@lo:400:kworker.0 00000100:00100000:1.0:1789130746.590151:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876038857812352:0@lo:400:kworker.0 00000100:00100000:1.0:1789130746.590183:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857811456:0@lo:400:kworker.0 00000100:00100000:1.0:1789130746.590195:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876038857811968:0@lo:400:kworker.0 00010000:00080000:1.0:1789130746.590223:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb4de03c0 x1876038857812480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130746.590234:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876038857812480:0@lo:400:kworker.0 00000100:00100000:0.0:1789130746.591577:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876038857812480:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130746.591607:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000001:00100000:0.0:1789130747.099965:0:25845:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 886c6038-f10d-4040-94e2-570d1de9fb6a 00000001:00080000:0.0:1789130747.099981:0:25845:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1789130747.288830:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130747.609092:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857812992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130747.609118:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857812864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130747.609190:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130747.609460:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130747.626437:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857812992 00000100:00100000:0.0:1789130747.626453:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857812992 00000100:00100000:2.0:1789130747.626512:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857812864 00000100:00100000:2.0:1789130747.626519:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857812864 00000100:00100000:0.0:1789130747.626529:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789130747.626544:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857812992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130747.626634:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789130747.626737:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857812992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 197us (17547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130747.626746:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789130747.626766:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789130747.626773:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857812864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130747.626792:0:23521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789130747.626811:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857812992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130747.626840:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857812864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (17381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130747.626848:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789130747.626979:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857812864:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789130747.737718:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789130748.313006:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130748.545455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130748.545733:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834615680 00000100:00100000:2.0:1789130748.545744:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834615680 00000100:00080000:1.0:1789130748.545925:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130748.546783:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:2.0:1789130748.546803:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+7:18508:x1876038834615680:12345-192.168.202.10@tcp:41:lfs.0 00000004:00000024:2.0:1789130748.546869:0:26319:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789130748.546987:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+7:18508:x1876038834615680:12345-192.168.202.10@tcp:41:lfs.0 Request processed in 192us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130748.546996:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:3.0:1789130748.553531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130748.555591:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834615808 00000100:00100000:1.0:1789130748.555606:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834615808 00000100:00100000:1.0:1789130748.555818:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:1.0:1789130748.555832:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18508:x1876038834615808:12345-192.168.202.10@tcp:41:lfs.0 00000004:00000024:1.0:1789130748.555874:0:23516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789130748.555982:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18508:x1876038834615808:12345-192.168.202.10@tcp:41:lfs.0 Request processed in 154us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130748.555991:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00080000:2.0:1789130748.557165:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130748.562968:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130748.563103:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834615936 00000100:00100000:2.0:1789130748.563115:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834615936 00000100:00100000:2.0:1789130748.563200:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1789130748.563211:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18508:x1876038834615936:12345-192.168.202.10@tcp:13:lfs.0 00002000:00000024:2.0:1789130748.563258:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789130748.563353:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:886c6038-f10d-4040-94e2-570d1de9fb6a+6:18508:x1876038834615936:12345-192.168.202.10@tcp:13:lfs.0 Request processed in 144us (400us total) trans 0 rc 0/0 00000100:00080000:3.0:1789130748.563605:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130748.564061:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:3.0:1789130748.568049:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130748.568687:0:25031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834616064 00000100:00100000:1.0:1789130748.568701:0:25031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834616064 00000100:00100000:1.0:1789130748.568818:0:25031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:1.0:1789130748.568828:0:25031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:886c6038-f10d-4040-94e2-570d1de9fb6a+5:18508:x1876038834616064:12345-192.168.202.10@tcp:13:lfs.0 00002000:00000024:1.0:1789130748.568889:0:25031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789130748.569003:0:25031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:886c6038-f10d-4040-94e2-570d1de9fb6a+5:18508:x1876038834616064:12345-192.168.202.10@tcp:13:lfs.0 Request processed in 175us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130748.569012:0:25031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00080000:3.0:1789130748.569062:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130748.831915:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130748.834012:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834616192 00000100:00100000:1.0:1789130748.834045:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834616192 00000100:00100000:1.0:1789130748.834135:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 133 00000100:00100000:1.0:1789130748.834147:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+10:18539:x1876038834616192:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130748.834166:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130748.834185:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83983200/0x76b2fec9b050992e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14d2e expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130748.834223:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83983200/0x76b2fec9b050992e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d2e expref: 11 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130748.834243:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83983200/0x76b2fec9b050992e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d2e expref: 11 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130748.834253:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83983200, rc 0) 00000100:00100000:1.0:1789130748.834358:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+11:18539:x1876038834616192:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 212us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130748.834365:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 133 00000100:00100000:0.0:1789130748.858416:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130748.858560:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834616320 00000100:00100000:3.0:1789130748.858572:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834616320 00000100:00100000:3.0:1789130748.858666:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 134 00000100:00100000:3.0:1789130748.858678:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+11:18539:x1876038834616320:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789130748.858924:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+11:18539:x1876038834616320:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 248us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130748.858933:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 134 00000100:00100000:3.0:1789130748.874409:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130748.874499:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834616448 00000100:00100000:2.0:1789130748.874511:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834616448 00000100:00100000:2.0:1789130748.874581:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 135 00000100:00100000:2.0:1789130748.874593:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+11:18539:x1876038834616448:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789130748.874805:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+11:18539:x1876038834616448:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 214us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130748.874813:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 135 00000100:00100000:0.0:1789130748.911969:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130748.912068:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834616576 00000100:00100000:1.0:1789130748.912079:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834616576 00000100:00100000:1.0:1789130748.912138:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 136 00000100:00100000:1.0:1789130748.912148:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+11:18547:x1876038834616576:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130748.912339:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+11:18547:x1876038834616576:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 191us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130748.912576:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 136 00000100:00100000:0.0:1789130748.931689:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130748.932048:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834616704 00000100:00100000:3.0:1789130748.932059:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834616704 00000100:00100000:3.0:1789130748.932226:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 137 00000100:00100000:3.0:1789130748.932240:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+11:18547:x1876038834616704:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130748.932460:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+11:18547:x1876038834616704:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 222us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130748.932469:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 137 00000100:00100000:0.0:1789130748.939573:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130748.939766:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834616832 00000100:00100000:1.0:1789130748.939776:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834616832 00000100:00100000:1.0:1789130748.939832:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 138 00000100:00100000:1.0:1789130748.939843:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+11:18547:x1876038834616832:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130748.940018:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+11:18547:x1876038834616832:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 175us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130748.940027:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 138 00000100:00100000:0.0:1789130748.945110:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130748.945212:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834616960 00000100:00100000:3.0:1789130748.945229:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834616960 00000100:00100000:3.0:1789130748.945302:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 139 00000100:00100000:3.0:1789130748.945313:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+11:18539:x1876038834616960:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789130748.945350:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130748.945382:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b8402f800/0x76b2fec9b0509935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14d5f expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130748.945413:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b8402f800/0x76b2fec9b0509935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d5f expref: 12 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130748.945426:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b8402f800/0x76b2fec9b0509935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d5f expref: 12 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130748.945437:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b8402f800, rc 0) 00000100:00100000:3.0:1789130748.945509:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+12:18539:x1876038834616960:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 198us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130748.945516:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 139 00000100:00100000:0.0:1789130748.948530:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130748.948644:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834617088 00000100:00100000:2.0:1789130748.948653:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834617088 00000100:00100000:2.0:1789130748.948707:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 140 00000100:00100000:2.0:1789130748.948715:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+12:18539:x1876038834617088:12345-192.168.202.10@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789130748.948741:0:23508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789130748.948765:0:23508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789130748.948770:0:23508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789130748.948814:0:23508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789130748.948818:0:23508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789130748.948820:0:23508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789130748.954914:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+12:18539:x1876038834617088:12345-192.168.202.10@tcp:256:mount.lustre.0 Request processed in 6180us (6375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130748.954947:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 140 00000100:00100000:0.0:1789130748.963688:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130748.963799:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834617216 00000100:00100000:1.0:1789130748.963810:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834617216 00000100:00100000:1.0:1789130748.963868:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 141 00000100:00100000:1.0:1789130748.963879:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+12:18539:x1876038834617216:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130748.963902:0:23509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130748.963926:0:23509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14d66 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130748.963960:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 13 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130748.963985:0:23509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 13 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130748.963994:0:23509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83983c00, rc 0) 00000100:00100000:1.0:1789130748.964068:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+13:18539:x1876038834617216:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 188us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130748.964078:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 141 00000100:00100000:0.0:1789130748.966776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130748.967058:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834617344 00000100:00100000:2.0:1789130748.967067:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834617344 00000100:00100000:2.0:1789130748.967123:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 142 00000100:00100000:2.0:1789130748.967133:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:18539:x1876038834617344:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789130748.967733:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:18539:x1876038834617344:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 599us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130748.967742:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 142 00000100:00100000:0.0:1789130748.973148:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130748.973288:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834617472 00000100:00100000:3.0:1789130748.973299:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834617472 00000100:00100000:3.0:1789130748.973365:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 143 00000100:00100000:3.0:1789130748.973375:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cc2065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+13:18539:x1876038834617472:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789130748.973524:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cc2065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+13:18539:x1876038834617472:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 149us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130748.973534:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 143 00000100:00100000:1.0:1789130748.978758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130748.978865:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834617600 00000100:00100000:2.0:1789130748.978877:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834617600 00000100:00100000:2.0:1789130748.978940:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 144 00000100:00100000:2.0:1789130748.978950:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:18551:x1876038834617600:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130748.979168:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:18551:x1876038834617600:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 220us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130748.979178:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 144 00000100:00100000:0.0:1789130748.990849:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130748.991109:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834617728 00000100:00100000:1.0:1789130748.991119:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834617728 00000100:00100000:1.0:1789130748.991244:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 145 00000100:00100000:1.0:1789130748.991266:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+13:18551:x1876038834617728:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130748.991959:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+13:18551:x1876038834617728:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 694us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130748.991973:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 145 00000100:00100000:0.0:1789130748.996924:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130748.997018:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834617856 00000100:00100000:3.0:1789130748.997028:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834617856 00000100:00100000:3.0:1789130748.997078:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:3.0:1789130748.997086:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1876038834617856:12345-192.168.202.10@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789130748.997122:0:23517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 765f1863-470f-4ca5-94b8-b8b93a24bcc1@192.168.202.10@tcp t0 exp 0000000000000000 cur 767 last 0 00000020:00000080:3.0:1789130748.997198:0:23517:0:(genops.c:1385:class_connect()) connect: client 765f1863-470f-4ca5-94b8-b8b93a24bcc1, cookie 0x76b2fec9b0509943 00000004:00100000:3.0:1789130748.997242:0:23517:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789130748.997512:0:23517:0:(import.c:65:import_set_state_nolock()) ffff9e9c834fa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130748.997587:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2398:x1876038834617856:12345-192.168.202.10@tcp:38:mount.lustre.0 Request processed in 499us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130748.997595:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:3.0:1789130749.004575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130749.004669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130749.004687:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130749.004739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130749.004766:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834618496 00000100:00100000:3.0:1789130749.004776:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834618496 00000100:00100000:3.0:1789130749.004827:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834618624 00000100:00100000:3.0:1789130749.004830:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834618624 00000100:00100000:3.0:1789130749.004852:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:3.0:1789130749.004861:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2401:x1876038834618496:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1789130749.004936:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2401:x1876038834618496:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 76us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130749.004944:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:3.0:1789130749.004961:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1789130749.004968:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834618624:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1789130749.004994:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834618624:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130749.005000:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:2.0:1789130749.005278:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834618240 00000100:00100000:2.0:1789130749.005283:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834618240 00000100:00100000:2.0:1789130749.005318:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834618368 00000100:00100000:2.0:1789130749.005321:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834618368 00000100:00100000:2.0:1789130749.005357:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:2.0:1789130749.005365:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2401:x1876038834618240:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130749.005401:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2401:x1876038834618240:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 38us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130749.005408:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:2.0:1789130749.005420:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:2.0:1789130749.005441:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2401:x1876038834618368:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130749.005467:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2401:x1876038834618368:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 28us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130749.005473:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:0.0:1789130749.007306:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130749.007456:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834618112 00000100:00100000:1.0:1789130749.007464:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834618112 00000100:00100000:1.0:1789130749.007511:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:1.0:1789130749.007518:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1876038834618112:12345-192.168.202.10@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789130749.007551:0:26319:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 765f1863-470f-4ca5-94b8-b8b93a24bcc1@192.168.202.10@tcp t0 exp 0000000000000000 cur 767 last 0 00000020:00000080:1.0:1789130749.007587:0:26319:0:(genops.c:1385:class_connect()) connect: client 765f1863-470f-4ca5-94b8-b8b93a24bcc1, cookie 0x76b2fec9b050994a 00000004:00100000:1.0:1789130749.007637:0:26319:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789130749.007741:0:26319:0:(import.c:65:import_set_state_nolock()) ffff9e9cada51000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130749.007812:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2398:x1876038834618112:12345-192.168.202.10@tcp:38:mount.lustre.0 Request processed in 292us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130749.007820:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:0.0:1789130749.013732:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130749.013780:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130749.013995:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834618880 00000100:00100000:1.0:1789130749.014006:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834618880 00000100:00100000:1.0:1789130749.014077:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834617984 00000100:00100000:1.0:1789130749.014081:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834617984 00000100:00100000:1.0:1789130749.014108:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:1.0:1789130749.014118:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+7:18539:x1876038834618880:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130749.014155:0:23515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789130749.014245:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+7:18539:x1876038834618880:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 129us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130749.014266:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:1.0:1789130749.014285:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:1.0:1789130749.014309:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:0:x1876038834617984:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130749.014321:0:23515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789130749.014345:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:0:x1876038834617984:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 37us (563us total) trans 0 rc 0/0 00000100:00080000:3.0:1789130749.014438:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130749.014917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130749.015019:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834618752 00000100:00100000:0.0:1789130749.015026:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834618752 00000100:00100000:0.0:1789130749.015084:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:0.0:1789130749.015097:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:0:x1876038834618752:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789130749.015119:0:26319:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789130749.015162:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:0:x1876038834618752:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130749.015168:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00080000:3.0:1789130749.015418:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130749.015552:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:0.0:1789130749.018785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130749.019437:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834619008 00000100:00100000:1.0:1789130749.019447:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834619008 00000100:00100000:1.0:1789130749.019501:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:1.0:1789130749.019508:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:18539:x1876038834619008:12345-192.168.202.10@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789130749.019588:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:18539:x1876038834619008:12345-192.168.202.10@tcp:40:mount.lustre.0 Request processed in 80us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130749.019593:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:0.0:1789130749.023666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130749.023845:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130749.023914:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130749.023938:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834619136 00000100:00100000:3.0:1789130749.023950:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834619136 00000100:00100000:3.0:1789130749.024010:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834619264 00000100:00100000:3.0:1789130749.024014:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834619264 00000100:00100000:3.0:1789130749.024033:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:3.0:1789130749.024041:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94427c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1876038834619136:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789130749.024083:0:25026:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 765f1863-470f-4ca5-94b8-b8b93a24bcc1@192.168.202.10@tcp t0 exp 0000000000000000 cur 767 last 0 00000020:00000080:3.0:1789130749.024115:0:25026:0:(genops.c:1385:class_connect()) connect: client 765f1863-470f-4ca5-94b8-b8b93a24bcc1, cookie 0x76b2fec9b0509951 00002000:00100000:3.0:1789130749.024127:0:25026:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 765f1863-470f-4ca5-94b8-b8b93a24bcc1/ffff9e9c834f8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789130749.024139:0:25026:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789130749.024374:0:25029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:1.0:1789130749.024381:0:25029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94426580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876038834619264:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789130749.024402:0:25029:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 765f1863-470f-4ca5-94b8-b8b93a24bcc1@192.168.202.10@tcp t0 exp 0000000000000000 cur 767 last 0 00000020:00000080:1.0:1789130749.024424:0:25029:0:(genops.c:1385:class_connect()) connect: client 765f1863-470f-4ca5-94b8-b8b93a24bcc1, cookie 0x76b2fec9b0509958 00002000:00100000:1.0:1789130749.024431:0:25029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 765f1863-470f-4ca5-94b8-b8b93a24bcc1/ffff9e9cada54800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130749.024439:0:25029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789130749.024444:0:25026:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789130749.024481:0:25026:0:(import.c:65:import_set_state_nolock()) ffff9e9c834fe000 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1789130749.024528:0:25029:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789130749.024553:0:25029:0:(import.c:65:import_set_state_nolock()) ffff9e9cada56000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130749.024554:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94427c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2398:x1876038834619136:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 511us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130749.024565:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:1.0:1789130749.024584:0:25029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94426580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2398:x1876038834619264:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 201us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130749.024594:0:25029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:2.0:1789130749.031373:0:23527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834619392 00000100:00100000:2.0:1789130749.031392:0:23527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834619392 00000100:00100000:2.0:1789130749.031522:0:23527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:2.0:1789130749.031535:0:23527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94424b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:18539:x1876038834619392:12345-192.168.202.10@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789130749.031698:0:23527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94424b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:18539:x1876038834619392:12345-192.168.202.10@tcp:900:mount.lustre.0 Request processed in 165us (8098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130749.031707:0:23527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:0.0:1789130749.046358:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130749.046515:0:23519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834619520 00000100:00100000:3.0:1789130749.046525:0:23519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834619520 00000100:00100000:3.0:1789130749.046579:0:23519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:3.0:1789130749.046590:0:23519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94424780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:18539:x1876038834619520:12345-192.168.202.10@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789130749.046727:0:23519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789130749.046815:0:23519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94424780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:18539:x1876038834619520:12345-192.168.202.10@tcp:33:mount.lustre.0 Request processed in 226us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130749.046823:0:23519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:3.0:1789130749.218341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130749.218752:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834619648 00000100:00100000:1.0:1789130749.218777:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834619648 00000100:00100000:1.0:1789130749.218857:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:1.0:1789130749.218867:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:18576:x1876038834619648:12345-192.168.202.10@tcp:101:mkdir.0 00010000:00010000:1.0:1789130749.218891:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130749.218916:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b050995f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14d97 expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130749.219107:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130749.219121:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130749.219141:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130749.219197:0:23517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789130749.219201:0:23517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789130749.219243:0:23517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130749.219282:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b050995f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 8 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130749.219301:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 7 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130749.219421:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbe200) 00010000:00010000:1.0:1789130749.219425:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130749.219429:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83983000, rc 0) 00000100:00100000:1.0:1789130749.219509:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+7:18576:x1876038834619648:12345-192.168.202.10@tcp:101:mkdir.0 Request processed in 643us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130749.219517:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00010000:00010000:1.0:1789130749.336769:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130750.360746:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130750.681800:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130750.681823:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857813120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130750.681896:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130750.681993:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857813120 00000100:00100000:2.0:1789130750.682001:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857813120 00000100:00100000:2.0:1789130750.682059:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789130750.682068:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94511a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857813120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130750.682099:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789130750.682146:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94511a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857813120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130750.682154:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789130750.682176:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130750.682215:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857813120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789130751.387814:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130751.705178:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3645:1876038857813248:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705333:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876038857813760:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705359:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705377:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876038857814272:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705415:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857814784:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705459:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789130751.705477:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857813632:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705529:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857814144:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705577:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876038857814656:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705652:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857813376:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705695:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857813888:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705726:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876038857814400:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705765:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789130751.705770:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857813504:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705797:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857814016:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705812:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705823:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857814528:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.705860:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857813248 00000100:00100000:1.0:1789130751.705866:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857813248 00000100:00100000:1.0:1789130751.705907:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789130751.705915:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3645:x1876038857813248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.705961:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3645:x1876038857813248:12345-0@lo:400:kworker.0 Request processed in 46us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.705968:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789130751.705999:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857813760 00000100:00100000:1.0:1789130751.706003:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857813760 00000100:00100000:1.0:1789130751.706020:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857814272 00000100:00100000:1.0:1789130751.706022:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857814272 00000100:00100000:1.0:1789130751.706033:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857814784 00000100:00100000:1.0:1789130751.706034:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857814784 00000100:00100000:1.0:1789130751.706055:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857814656 00000100:00100000:1.0:1789130751.706058:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857814656 00000100:00100000:1.0:1789130751.706068:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857814400 00000100:00100000:1.0:1789130751.706070:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857814400 00000100:00100000:1.0:1789130751.706081:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857814528 00000100:00100000:1.0:1789130751.706083:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857814528 00000100:00100000:1.0:1789130751.706096:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789130751.706102:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876038857813760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706135:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876038857813760:12345-0@lo:400:kworker.0 Request processed in 34us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706141:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789130751.706152:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130751.706156:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876038857814272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706174:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876038857814272:12345-0@lo:400:kworker.0 Request processed in 18us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706180:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130751.706188:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130751.706193:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876038857814784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706211:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876038857814784:12345-0@lo:400:kworker.0 Request processed in 18us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706216:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130751.706224:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789130751.706228:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876038857814656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706262:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876038857814656:12345-0@lo:400:kworker.0 Request processed in 33us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706267:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789130751.706276:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789130751.706281:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876038857814400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706305:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876038857814400:12345-0@lo:400:kworker.0 Request processed in 24us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706310:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789130751.706319:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789130751.706324:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857814528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706352:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857814528:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706357:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789130751.706377:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857813632 00000100:00100000:1.0:1789130751.706380:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857813632 00000100:00100000:1.0:1789130751.706399:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857814144 00000100:00100000:1.0:1789130751.706401:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857814144 00000100:00100000:1.0:1789130751.706410:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857813504 00000100:00100000:1.0:1789130751.706412:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857813504 00000100:00100000:1.0:1789130751.706420:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857814016 00000100:00100000:1.0:1789130751.706422:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857814016 00000100:00100000:1.0:1789130751.706434:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130751.706439:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857813632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706466:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857813632:12345-0@lo:400:kworker.0 Request processed in 27us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706471:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130751.706482:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789130751.706487:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857814144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706529:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876038857814144:12345-0@lo:400:kworker.0 Request processed in 42us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706534:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789130751.706545:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130751.706551:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857813504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706575:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857813504:12345-0@lo:400:kworker.0 Request processed in 25us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706580:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130751.706589:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130751.706601:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857814016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706650:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857814016:12345-0@lo:400:kworker.0 Request processed in 51us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706656:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130751.706708:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857813376 00000100:00100000:1.0:1789130751.706711:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857813376 00000100:00100000:1.0:1789130751.706725:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857813888 00000100:00100000:1.0:1789130751.706726:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857813888 00000100:00100000:1.0:1789130751.706736:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789130751.706741:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857813376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706767:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857813376:12345-0@lo:400:kworker.0 Request processed in 26us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706773:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789130751.706781:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789130751.706786:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857813888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706804:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857813888:12345-0@lo:400:kworker.0 Request processed in 18us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130751.706809:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789130751.706831:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130751.706834:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130751.706837:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130751.706839:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130751.706844:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130751.706854:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857814912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130751.706878:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.706926:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857813504:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706937:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857814016:0@lo:400:kworker.0 00010000:00080000:1.0:1789130751.706958:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb4ea1a40 x1876038857814528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130751.706968:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857814528:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706977:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857813376:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706986:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857813888:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.706995:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876038857814400:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.707036:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789130751.707046:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857813632:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.707054:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876038857814144:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.707063:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876038857814656:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.707071:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3645:1876038857813248:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.707080:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876038857813760:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.707090:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876038857814272:0@lo:400:kworker.0 00010000:00080000:1.0:1789130751.707100:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9cb74bd2c0 x1876038857814784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130751.707108:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876038857814784:0@lo:400:kworker.0 00000100:00100000:1.0:1789130751.709259:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857815168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130751.709319:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130751.710084:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b8407e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857815040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130751.710127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130751.716054:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857814912 00000100:00100000:3.0:1789130751.716070:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857814912 00000100:00100000:3.0:1789130751.716119:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857815168 00000100:00100000:3.0:1789130751.716123:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857815168 00000100:00100000:3.0:1789130751.716133:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857815040 00000100:00100000:3.0:1789130751.716136:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857815040 00000100:00100000:3.0:1789130751.716153:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130751.716162:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857814912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130751.717028:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130751.717144:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857814912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 979us (10261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130751.717152:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130751.717172:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130751.717190:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857815168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130751.717204:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130751.717248:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857815168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (7929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130751.717254:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130751.717264:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130751.717270:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857815040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130751.717281:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789130751.717307:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857815040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (7180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130751.717313:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130751.717746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b8407e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857815040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130751.717764:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857814912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130751.717822:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857815168:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789130752.084125:0:26406:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1789130752.222520:0:25023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 765f1863-470f-4ca5-94b8-b8b93a24bcc1 00000001:00100000:3.0:1789130752.222532:0:25023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 886c6038-f10d-4040-94e2-570d1de9fb6a 00000001:00100000:2.0:1789130752.223043:0:24253:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 765f1863-470f-4ca5-94b8-b8b93a24bcc1 00000001:00100000:2.0:1789130752.223050:0:24253:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 886c6038-f10d-4040-94e2-570d1de9fb6a 00000001:00100000:2.0:1789130752.223254:0:23495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 765f1863-470f-4ca5-94b8-b8b93a24bcc1 00000001:00100000:2.0:1789130752.223260:0:23495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 886c6038-f10d-4040-94e2-570d1de9fb6a 00010000:00010000:1.0:1789130752.409534:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130752.729048:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130752.729075:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857815296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130752.729155:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130752.729267:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857815296 00000100:00100000:2.0:1789130752.729275:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857815296 00000100:00100000:2.0:1789130752.729335:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789130752.729345:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857815296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130752.729382:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789130752.729451:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857815296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130752.729459:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130752.729577:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857815296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130752.730142:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130752.730155:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857815424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130752.730185:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130752.730300:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857815424 00000100:00100000:2.0:1789130752.730304:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857815424 00000100:00100000:2.0:1789130752.730339:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789130752.730347:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857815424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130752.730368:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789130752.730423:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857815424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130752.730429:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789130752.730557:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857815424:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789130753.447253:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789130753.885756:0:24277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789130754.042475:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130754.042503:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130754.042543:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130754.042559:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130754.042574:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130754.042588:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130754.042632:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130754.042654:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130754.043405:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834619776 00000100:00100000:2.0:1789130754.043418:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834619776 00000100:00100000:2.0:1789130754.043481:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 147 00000100:00100000:2.0:1789130754.043490:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:2401:x1876038834619776:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.043568:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:2401:x1876038834619776:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 78us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.043586:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 147 00000100:00100000:2.0:1789130754.043767:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834620032 00000100:00100000:2.0:1789130754.043771:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834620032 00000100:00100000:2.0:1789130754.043801:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834620544 00000100:00100000:2.0:1789130754.043803:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834620544 00000100:00100000:2.0:1789130754.043826:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834619904 00000100:00100000:2.0:1789130754.043829:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834619904 00000100:00100000:2.0:1789130754.043840:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834620416 00000100:00100000:2.0:1789130754.043842:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834620416 00000100:00100000:2.0:1789130754.043854:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:2.0:1789130754.043859:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94426d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834620032:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.043891:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94426d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834620032:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 32us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.043898:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:2.0:1789130754.043908:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:2.0:1789130754.043913:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834620544:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.043931:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834620544:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 18us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.043937:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:2.0:1789130754.043945:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:2.0:1789130754.043949:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94425680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2401:x1876038834619904:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.043966:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94425680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2401:x1876038834619904:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 17us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.043972:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:2.0:1789130754.043980:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:2.0:1789130754.043991:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2401:x1876038834620416:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.044010:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2401:x1876038834620416:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 20us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.044015:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:2.0:1789130754.044030:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834620288 00000100:00100000:2.0:1789130754.044033:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834620288 00000100:00100000:2.0:1789130754.044054:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834620800 00000100:00100000:2.0:1789130754.044056:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834620800 00000100:00100000:2.0:1789130754.044069:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834620160 00000100:00100000:2.0:1789130754.044071:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834620160 00000100:00100000:2.0:1789130754.044085:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:2.0:1789130754.044090:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94425a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834620288:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.044111:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94425a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834620288:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 22us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.044117:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:2.0:1789130754.044126:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1789130754.044131:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2401:x1876038834620800:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.044146:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2401:x1876038834620800:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 15us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.044151:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1789130754.044159:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:2.0:1789130754.044163:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834620160:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.044179:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834620160:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 15us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.044184:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00080000:2.0:1789130754.044206:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130754.044221:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130754.044224:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130754.044226:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789130754.064203:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130754.064360:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834620672 00000100:00100000:2.0:1789130754.064372:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834620672 00000100:00100000:2.0:1789130754.064496:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:2.0:1789130754.064507:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834620672:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1789130754.064606:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834620672:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 100us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130754.064648:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00080000:1.0:1789130754.064768:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789130754.466454:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789130755.290943:0:25845:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 765f1863-470f-4ca5-94b8-b8b93a24bcc1 00010000:00010000:1.0:1789130755.490924:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130755.803652:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb74bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857815552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130755.803730:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130755.803902:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857815552 00000100:00100000:1.0:1789130755.803912:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857815552 00000100:00100000:1.0:1789130755.803975:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130755.803986:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857815552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130755.804017:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789130755.804063:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857815552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130755.804071:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789130755.804092:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130755.804156:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb74bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857815552:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789130755.804737:0:26553:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6eb5d640 20000000:00000080:3.0:1789130755.804828:0:26553:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e9cb584fc00 uarg=0000000000000000 20000000:01000000:3.0:1789130755.804875:0:26553:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789130755.804882:0:26553:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789130755.804887:0:26553:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789130755.806416:0:26554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:3.0:1789130755.806892:0:26553:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789130755.822186:0:26553:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789130755.822235:0:26553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822255:0:26553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822264:0:26553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822288:0:26553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 23 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822296:0:26553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b050978a expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822308:0:26553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 12 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822315:0:26553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 12 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822323:0:26553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822376:0:26553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 12 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.822393:0:26553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 12 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.822407:0:26553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b8407f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857815680:192.168.202.10@tcp:104: 00010000:00010000:3.0:1789130755.823133:0:26553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 12 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.823143:0:26553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 12 pid: 23510 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.823153:0:26553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857815808:192.168.202.10@tcp:104: 00010000:00010000:3.0:1789130755.823213:0:26553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b050978a expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.823222:0:26553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b050978a expref: 23 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.823232:0:26553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857815936:0@lo:104: 00000100:00100000:3.0:1789130755.823275:0:26553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130755.823356:0:26553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 23 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.823364:0:26553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 23 pid: 23508 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.823372:0:26553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857816064:0@lo:104: 00000100:00100000:3.0:1789130755.823392:0:26553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130755.831020:0:26553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.831040:0:26553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 23 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.831065:0:26553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857816192:0@lo:104: 00000100:00100000:3.0:1789130755.831124:0:26553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130755.831477:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857815936 00000100:00100000:0.0:1789130755.831487:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857815936 00000100:00100000:0.0:1789130755.831539:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857816064 00000100:00100000:0.0:1789130755.831542:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857816064 00000100:00100000:0.0:1789130755.831558:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130755.831567:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:26553:x1876038857815936:12345-0@lo:104: 00010000:00010000:0.0:1789130755.831581:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.831655:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130755.831662:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+4:26553:x1876038857815936:12345-0@lo:104: Request processed in 97us (8388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130755.831670:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130755.831688:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130755.831694:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:26553:x1876038857816064:12345-0@lo:104: 00010000:00010000:0.0:1789130755.831702:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.831740:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130755.831774:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:26553:x1876038857816064:12345-0@lo:104: Request processed in 80us (8380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130755.831781:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789130755.831809:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130755.831815:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.831822:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c9fb95800 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:0.0:1789130755.831826:0:23503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.831835:0:23503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130755.831842:0:23503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130755.831849:0:23503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130755.831884:0:23503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.831890:0:23503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130755.832450:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.832461:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9c9fb95800/0x76b2fec9b050978a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509791 expref: -99 pid: 25844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.832486:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130755.832490:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.832515:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a93000 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:0.0:1789130755.832518:0:23503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.832525:0:23503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130755.832532:0:23503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130755.832537:0:23503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130755.832556:0:23503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.832562:0:23503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130755.832570:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.832576:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93000/0x76b2fec9b0509610 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b0509617 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.832587:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130755.832588:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130755.832590:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130755.832600:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130755.832644:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857816320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130755.832681:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130755.832718:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130755.832723:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aaf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857816448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130755.832764:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130755.832794:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857816320 00000100:00100000:0.0:1789130755.832799:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857816320 00010000:00010000:0.0:1789130755.832842:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050978a expref: 24 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130755.832865:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857816448 00000100:00100000:0.0:1789130755.832868:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857816448 00010000:00010000:0.0:1789130755.832879:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 25 pid: 23508 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130755.832891:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130755.832897:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+25:3644:x1876038857816320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130755.833276:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130755.833295:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b050978a expref: 25 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.833306:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b050978a expref: 25 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130755.833314:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1789130755.833326:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130755.833356:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+25:3644:x1876038857816320:12345-0@lo:103:ldlm_bl.0 Request processed in 459us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130755.833362:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130755.833376:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834621056 00000100:00100000:0.0:1789130755.833379:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834621056 00000100:00100000:1.0:1789130755.833380:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1789130755.833391:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 13 pid: 23510 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130755.833402:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834620928 00000100:00100000:0.0:1789130755.833412:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834620928 00000100:00100000:1.0:1789130755.833422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857816320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130755.833425:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 14 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130755.833437:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130755.833442:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3644:x1876038857816448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130755.833449:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130755.833453:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 24 pid: 23508 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.833460:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 24 pid: 23508 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.833470:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130755.833747:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3644:x1876038857816448:12345-0@lo:103:ldlm_bl.0 Request processed in 303us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130755.833901:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aaf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857816448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130755.834162:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130755.834181:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:0.0:1789130755.834260:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1208214-416c-40c9-b997-874a76bc0c4a+14:2401:x1876038834621056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130755.834269:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130755.834275:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 14 pid: 23510 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.834343:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 14 pid: 23510 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.834359:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130755.834407:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1208214-416c-40c9-b997-874a76bc0c4a+14:2401:x1876038834621056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 151us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130755.834426:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:0.0:1789130755.834440:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:0.0:1789130755.834446:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1208214-416c-40c9-b997-874a76bc0c4a+13:2401:x1876038834620928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130755.834454:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130755.834459:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 13 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.834468:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 13 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.834737:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130755.834771:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1208214-416c-40c9-b997-874a76bc0c4a+13:2401:x1876038834620928:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 324us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130755.834778:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00010000:00010000:3.0:1789130755.836395:0:26553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 23 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.836413:0:26553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 23 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.836446:0:26553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857816576:0@lo:104: 00000100:00100000:0.0:1789130755.836720:0:23499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857816192 00000100:00100000:0.0:1789130755.836727:0:23499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857816192 00000100:00100000:0.0:1789130755.836789:0:23499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130755.836798:0:23499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:26553:x1876038857816192:12345-0@lo:104: 00010000:00010000:0.0:1789130755.836812:0:23499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130755.836870:0:23499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130755.836876:0:23499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:26553:x1876038857816192:12345-0@lo:104: Request processed in 79us (5752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130755.836883:0:23499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789130755.837070:0:26553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130755.837217:0:26553:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84540 going to sleep for 11 seconds 00010000:00010000:3.0:1789130755.837243:0:26553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83983c00/0x76b2fec9b050993c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d66 expref: 12 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.837256:0:26553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b8407f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857815680:192.168.202.10@tcp:104: 00010000:00010000:3.0:1789130755.837269:0:26553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83983a00/0x76b2fec9b05098fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14cf6 expref: 11 pid: 23510 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.837277:0:26553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857815808:192.168.202.10@tcp:104: 00010000:00010000:1.0:1789130755.837420:0:23504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130755.837428:0:23504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.837436:0:23504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a93200 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:1.0:1789130755.837440:0:23504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.837448:0:23504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.837449:0:26553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c9fb94800/0x76b2fec9b0509791 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b050978a expref: 23 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.837459:0:26553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857815936:0@lo:104: 10000000:00010000:1.0:1789130755.837465:0:23504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.837468:0:26553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9cb4e6b400/0x76b2fec9b0509617 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b0509610 expref: 22 pid: 23508 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130755.837472:0:23504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789130755.837488:0:26553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857816064:0@lo:104: 00010000:00010000:1.0:1789130755.837506:0:23504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.837512:0:23504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130755.837530:0:23504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.837536:0:23504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83a93200/0x76b2fec9b05095d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095d8 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.837548:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130755.837550:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130755.837552:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130755.837606:0:26553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857816192:0@lo:104: 00000100:00100000:2.0:1789130755.837705:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3642:1876038857816704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130755.837756:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130755.837801:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857816576 00000100:00100000:2.0:1789130755.837806:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857816576 00000100:00100000:2.0:1789130755.837829:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130755.837836:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:26553:x1876038857816576:12345-0@lo:104: 00010000:00010000:2.0:1789130755.837845:0:23498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130755.837874:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857816704 00000100:00100000:1.0:1789130755.837878:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857816704 00010000:00010000:2.0:1789130755.837889:0:23498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130755.837894:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+3:26553:x1876038857816576:12345-0@lo:104: Request processed in 59us (825us total) trans 0 rc 0/0 00010000:00010000:1.0:1789130755.837897:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 22 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130755.837900:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789130755.837915:0:23503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130755.837919:0:23503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130755.837927:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789130755.837933:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac764850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:3642:x1876038857816704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130755.837937:0:23503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83a92000 already unused, calling callback (ffffffffc1266c20) 10000000:00010000:2.0:1789130755.837940:0:23503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.837942:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130755.837946:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 22 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130755.837947:0:23503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130755.837954:0:23503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.837957:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 22 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130755.837959:0:23503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789130755.837975:0:23502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b83a92800/0x76b2fec9b05095d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b05095d1 expref: 22 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130755.837976:0:23503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130755.837982:0:23503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130755.837988:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130755.837990:0:23503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130755.837996:0:23503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff9e9b83a92000/0x76b2fec9b05095c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76b2fec9b05095ca expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130755.838009:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130755.838011:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130755.838012:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130755.838014:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac764850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3642:x1876038857816704:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130755.838020:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789130755.838032:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3642:1876038857816704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130755.838045:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130755.838051:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3642:1876038857816832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130755.838089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130755.838284:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857816832 00000100:00100000:1.0:1789130755.838288:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857816832 00010000:00010000:1.0:1789130755.838379:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 21 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130755.838398:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789130755.838404:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94513840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3642:x1876038857816832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130755.838412:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130755.838416:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 21 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838425:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 21 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838438:0:23500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838447:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838461:0:23500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838477:0:23500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838484:0:23500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838490:0:23500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838496:0:23500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402f600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130755.838500:0:23500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838508:0:23500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838517:0:23500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130755.838525:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130755.838566:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94513840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:3642:x1876038857816832:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130755.838573:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130755.838586:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3642:1876038857816832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130755.838845:0:26553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9c9fb94000/0x76b2fec9b05095ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76b2fec9b05095c3 expref: 20 pid: 23509 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130755.838858:0:26553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26553:1876038857816576:0@lo:104: 00010000:00010000:3.0:1789130755.838886:0:26553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.838907:0:26553:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.838913:0:26553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130755.838920:0:26553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e9b8402f600/0x76b2fec9b050996d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130756.506380:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130756.824850:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857816960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130756.824931:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130756.825147:0:25031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857816960 00000100:00100000:0.0:1789130756.825158:0:25031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857816960 00000100:00100000:0.0:1789130756.825264:0:25031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789130756.825289:0:25031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857816960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789130756.825319:0:25031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789130756.825370:0:25031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857816960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.825377:0:25031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789130756.825398:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130756.825707:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857816960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130756.827033:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857817088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130756.827102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130756.827354:0:25031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857817088 00000100:00100000:1.0:1789130756.827361:0:25031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857817088 00000100:00100000:1.0:1789130756.827418:0:25031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130756.827427:0:25031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857817088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130756.827455:0:25031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789130756.827503:0:25031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857817088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130756.827525:0:25031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130756.827923:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857817216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130756.827970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130756.828005:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857817344:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.828042:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789130756.828105:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130756.828121:0:25031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857817216 00000100:00100000:2.0:1789130756.828125:0:25031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857817216 00000100:00100000:0.0:1789130756.828131:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83ae92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857817088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130756.828154:0:25031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130756.828159:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857817344 00000100:00100000:2.0:1789130756.828161:0:25031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c98da7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857817216:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130756.828174:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857817344 00002000:00000024:2.0:1789130756.828181:0:25031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789130756.828228:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789130756.828236:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c88dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:3643:x1876038857817344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.828272:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c88dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:3643:x1876038857817344:12345-0@lo:400:kworker.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.828279:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789130756.828314:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3643:1876038857817344:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.840384:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857817472:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.840471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130756.840556:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857817984:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.840603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130756.840664:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876038857818496:0@lo:400:kworker.0 00000100:00100000:1.0:1789130756.840668:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876038857817728:0@lo:400:kworker.0 00000100:00100000:3.0:1789130756.840733:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857817856:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.852920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130756.852996:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789130756.853010:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857817600:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853069:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130756.853095:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876038857818112:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130756.853180:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857817984 00000100:00100000:0.0:1789130756.853198:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857817984 00000100:00100000:0.0:1789130756.853252:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857818496 00000100:00100000:0.0:1789130756.853255:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857818496 00000100:00100000:0.0:1789130756.853274:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857818112 00000100:00100000:0.0:1789130756.853276:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857818112 00000100:00100000:0.0:1789130756.853293:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130756.853301:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857817984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853356:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857817984:12345-0@lo:400:kworker.0 Request processed in 56us (12752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.853364:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130756.853382:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789130756.853389:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876038857818496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853417:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876038857818496:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.853423:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789130756.853434:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789130756.853440:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876038857818112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853484:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876038857818112:12345-0@lo:400:kworker.0 Request processed in 44us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.853491:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789130756.853512:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857817600 00000100:00100000:0.0:1789130756.853515:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857817600 00000100:00100000:0.0:1789130756.853541:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130756.853563:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aafc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857817600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853594:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aafc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857817600:12345-0@lo:400:kworker.0 Request processed in 32us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.853600:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789130756.853641:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130756.853644:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130756.853646:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130756.853678:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857817600:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853689:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876038857818112:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853698:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857817984:0@lo:400:kworker.0 00010000:00080000:0.0:1789130756.853711:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9c944c61c0 x1876038857818496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130756.853721:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876038857818496:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853788:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857817472 00000100:00100000:0.0:1789130756.853792:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857817472 00000100:00100000:0.0:1789130756.853818:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789130756.853825:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857817472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.853864:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857817472:12345-0@lo:400:kworker.0 Request processed in 40us (13393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.853881:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789130756.853914:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857817472:0@lo:400:kworker.0 00000100:00100000:1.0:1789130756.865663:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130756.865732:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857818240:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.865867:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857817728 00000100:00100000:0.0:1789130756.865877:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857817728 00000100:00100000:0.0:1789130756.865939:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789130756.865949:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876038857817728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.866171:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876038857817728:12345-0@lo:400:kworker.0 Request processed in 223us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.867852:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789130756.868073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130756.868136:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c94511e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857817216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130756.868171:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876038857817728:0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.869094:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857818240 00000100:00100000:0.0:1789130756.869104:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857818240 00000100:00100000:0.0:1789130756.870967:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789130756.870998:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb74bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857818240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.871096:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb74bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876038857818240:12345-0@lo:400:kworker.0 Request processed in 117us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.871104:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789130756.871459:0:25031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c98da7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857817216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43296us (43499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130756.871478:0:25031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789130756.872211:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789130756.872261:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9c944c52c0 x1876038857818240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130756.872278:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876038857818240:0@lo:400:kworker.0 00000100:00100000:3.0:1789130756.876212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130756.876291:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876038857818368:0@lo:400:kworker.0 00000100:00100000:3.0:1789130756.876339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130756.876555:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857818368 00000100:00100000:1.0:1789130756.876567:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857818368 00000100:00100000:0.0:1789130756.876788:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789130756.876798:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876038857818368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130756.876861:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876038857818368:12345-0@lo:400:kworker.0 Request processed in 63us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.876869:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130756.876959:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876038857818368:0@lo:400:kworker.0 00000100:00100000:2.0:1789130756.877292:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857817856 00000100:00100000:2.0:1789130756.877297:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857817856 00000100:00100000:2.0:1789130756.877328:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789130756.877334:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857817856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130756.877385:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857817856:12345-0@lo:400:kworker.0 Request processed in 51us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130756.877390:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789130756.877694:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857817856:0@lo:400:kworker.0 00000100:00080000:1.0:1789130756.877757:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130756.925099:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130756.925243:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834621184 00000100:00100000:0.0:1789130756.925255:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834621184 00000100:00100000:0.0:1789130756.925321:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 149 00000100:00100000:0.0:1789130756.925331:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c8612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+11:18422:x1876038834621184:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130756.925367:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130756.925392:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c829d9400/0x76b2fec9b0509974 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14d9e expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130756.925425:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c829d9400/0x76b2fec9b0509974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d9e expref: 12 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130756.925437:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c829d9400/0x76b2fec9b0509974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d9e expref: 12 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130756.925447:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9400, rc 0) 00000100:00100000:0.0:1789130756.925513:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c8612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+12:18422:x1876038834621184:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 184us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.925521:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 149 00000100:00100000:1.0:1789130756.940482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130756.940586:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834621312 00000100:00100000:0.0:1789130756.940598:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834621312 00000100:00100000:0.0:1789130756.940706:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 150 00000100:00100000:0.0:1789130756.940717:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+12:18422:x1876038834621312:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130756.940994:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+12:18422:x1876038834621312:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 278us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.941002:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 150 00000100:00100000:2.0:1789130756.948764:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130756.948847:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834621440 00000100:00100000:1.0:1789130756.948858:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834621440 00000100:00100000:1.0:1789130756.948919:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 151 00000100:00100000:1.0:1789130756.948930:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+12:18422:x1876038834621440:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130756.949090:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+12:18422:x1876038834621440:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 162us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130756.949099:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 151 00000100:00100000:2.0:1789130756.973846:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130756.978568:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834621568 00000100:00100000:0.0:1789130756.978586:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834621568 00000100:00100000:0.0:1789130756.978711:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 152 00000100:00100000:0.0:1789130756.978723:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+12:18422:x1876038834621568:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130756.978752:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130756.978788:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c829d9800/0x76b2fec9b050997b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14da5 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130756.978826:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c829d9800/0x76b2fec9b050997b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14da5 expref: 13 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130756.978839:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c829d9800/0x76b2fec9b050997b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14da5 expref: 13 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130756.978850:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9800, rc 0) 00000100:00100000:0.0:1789130756.978948:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:18422:x1876038834621568:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 227us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130756.978956:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 152 00000100:00100000:3.0:1789130756.989712:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130756.990875:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834621696 00000100:00100000:2.0:1789130756.990903:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834621696 00000100:00100000:2.0:1789130756.990979:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 153 00000100:00100000:2.0:1789130756.990990:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+13:18422:x1876038834621696:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130756.991200:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1208214-416c-40c9-b997-874a76bc0c4a+13:18422:x1876038834621696:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 211us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130756.991208:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 153 00000100:00100000:3.0:1789130757.003609:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130757.003813:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834621824 00000100:00100000:1.0:1789130757.003823:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834621824 00000100:00100000:1.0:1789130757.003883:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 154 00000100:00100000:1.0:1789130757.003904:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+13:18422:x1876038834621824:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130757.004062:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1208214-416c-40c9-b997-874a76bc0c4a+13:18422:x1876038834621824:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 170us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130757.004071:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 154 00000100:00100000:3.0:1789130757.528464:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.528539:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834621952 00000100:00100000:0.0:1789130757.528550:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834621952 00000100:00100000:0.0:1789130757.528664:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:0.0:1789130757.528675:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+6:19045:x1876038834621952:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130757.528694:0:23515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130757.528716:0:23515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b0509982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14dac expref: -99 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.528782:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.528796:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.528822:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789130757.528834:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130757.528855:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.528863:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.528871:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.528949:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8e00/0x76b2fec9b0509997 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.528957:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8e00/0x76b2fec9b0509997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.528965:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8e00/0x76b2fec9b0509997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130757.529001:0:23515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789130757.529004:0:23515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789130757.529062:0:23515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8e00/0x76b2fec9b0509997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529072:0:23515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529078:0:23515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529085:0:23515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529099:0:23515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8600 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:0.0:1789130757.529103:0:23515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529120:0:23515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529132:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbe200) 00010000:00010000:0.0:1789130757.529135:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130757.529140:0:23515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529146:0:23515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b0509989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529159:0:23515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529166:0:23515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529171:0:23515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529185:0:23515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8c00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:0.0:1789130757.529188:0:23515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529194:0:23515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529213:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e9cbc5f1800) 00010000:00010000:0.0:1789130757.529216:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130757.529220:0:23515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529226:0:23515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b0509990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529265:0:23515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b0509982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dac expref: 8 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529282:0:23515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8e00/0x76b2fec9b0509997 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dac expref: 7 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.529290:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9cbc5f1b00) 00010000:00010000:0.0:1789130757.529293:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130757.529296:0:23515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d8e00, rc 0) 00010000:00010000:1.0:1789130757.529311:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130757.529371:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+7:19045:x1876038834621952:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 695us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.529380:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:1.0:1789130757.542950:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130757.543099:0:23527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834622080 00000100:00100000:2.0:1789130757.543122:0:23527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834622080 00000100:00100000:2.0:1789130757.543212:0:23527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:2.0:1789130757.543223:0:23527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb34921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:886c6038-f10d-4040-94e2-570d1de9fb6a+7:19045:x1876038834622080:12345-192.168.202.10@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789130757.543319:0:23527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb34921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:886c6038-f10d-4040-94e2-570d1de9fb6a+7:19045:x1876038834622080:12345-192.168.202.10@tcp:900:lhsmtool_posix.0 Request processed in 97us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.543328:0:23527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:3.0:1789130757.552536:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.552838:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834622336 00000100:00100000:0.0:1789130757.552850:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834622336 00000100:00100000:0.0:1789130757.552923:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:0.0:1789130757.552934:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+7:19045:x1876038834622336:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130757.552956:0:23516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130757.552989:0:23516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b050999e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14db3 expref: -99 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553093:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553108:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553120:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553134:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553140:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553147:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553277:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8800/0x76b2fec9b05099b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553286:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8800/0x76b2fec9b05099b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553293:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8800/0x76b2fec9b05099b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130757.553303:0:23516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789130757.553456:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553474:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553495:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553502:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8c00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:0.0:1789130757.553506:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553514:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553528:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e9cbc5f1b00) 00010000:00010000:0.0:1789130757.553532:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130757.553536:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553543:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8c00/0x76b2fec9b05099a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553558:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553565:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553571:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553576:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8600 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:0.0:1789130757.553586:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553593:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553601:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e9cbc5f1800) 00010000:00010000:0.0:1789130757.553605:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130757.553608:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.553959:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8600/0x76b2fec9b05099ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.555108:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b050999e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14db3 expref: 10 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.555129:0:23516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8800/0x76b2fec9b05099b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14db3 expref: 9 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.555138:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9cbc5f1000) 00010000:00010000:0.0:1789130757.555141:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130757.555144:0:23516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d8800, rc 0) 00000100:00100000:0.0:1789130757.555233:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+9:19045:x1876038834622336:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 2300us (2705us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789130757.555243:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:3.0:1789130757.557657:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.558018:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834622464 00000100:00100000:0.0:1789130757.558029:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834622464 00000100:00100000:0.0:1789130757.558136:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:0.0:1789130757.558146:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+9:19045:x1876038834622464:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789130757.558279:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+9:19045:x1876038834622464:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 Request processed in 134us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.558287:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:3.0:1789130757.565703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.565866:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834622592 00000100:00100000:0.0:1789130757.565878:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834622592 00000100:00100000:0.0:1789130757.565960:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:0.0:1789130757.565972:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+5:19045:x1876038834622592:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789130757.567369:0:23517:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1352us 00000100:00080000:1.0:1789130757.568214:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789130757.585481:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+5:19045:x1876038834622592:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 Request processed in 19498us (19775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.585496:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:2.0:1789130757.602754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.603742:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834622720 00000100:00100000:0.0:1789130757.603755:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834622720 00000100:00100000:2.0:1789130757.603950:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:2.0:1789130757.603962:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94511e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+9:19051:x1876038834622720:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1789130757.603987:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130757.604009:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14dba expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604074:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604088:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604099:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604112:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604118:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604138:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604196:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604801:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604810:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604817:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353ee00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130757.604821:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604829:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604843:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbe200) 00010000:00010000:2.0:1789130757.604846:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130757.604851:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604869:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ee00/0x76b2fec9b05099c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604885:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604892:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604907:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604913:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f400 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130757.604916:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604923:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604931:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e9cb3dbe700) 00010000:00010000:2.0:1789130757.604934:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130757.604937:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604944:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604981:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dba expref: 10 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.604991:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbe200) 00010000:00010000:2.0:1789130757.604994:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130757.604998:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dba expref: 10 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.605008:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353f200, rc 0) 00000100:00100000:2.0:1789130757.605079:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94511e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+9:19051:x1876038834622720:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1120us (2474us total) trans 0 rc 301/301 00000100:00100000:2.0:1789130757.605096:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:2.0:1789130757.608659:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.608761:0:23524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834622848 00000100:00100000:0.0:1789130757.608771:0:23524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834622848 00000100:00100000:0.0:1789130757.608821:0:23524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:0.0:1789130757.608831:0:23524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94510f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:886c6038-f10d-4040-94e2-570d1de9fb6a+9:19051:x1876038834622848:12345-192.168.202.10@tcp:700:lfs.0 00000100:00100000:0.0:1789130757.608954:0:23524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94510f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:886c6038-f10d-4040-94e2-570d1de9fb6a+9:19051:x1876038834622848:12345-192.168.202.10@tcp:700:lfs.0 Request processed in 124us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.608962:0:23524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:3.0:1789130757.610807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130757.610886:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834623104 00000100:00100000:1.0:1789130757.610895:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834623104 00000100:00100000:1.0:1789130757.610943:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:1.0:1789130757.610952:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+9:19051:x1876038834623104:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:1.0:1789130757.611003:0:23516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130757.611030:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509927 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d27 expref: 9 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.611045:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbe200) 00010000:00010000:1.0:1789130757.611048:0:23516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130757.611102:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.611111:0:23516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 5 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.611117:0:23516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.611153:0:23516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 5 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.611166:0:23516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 5 pid: 23517 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130757.611188:0:23516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb4ea0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23516:1876038857818624:192.168.202.10@tcp:104: 00000100:00100000:1.0:1789130757.611258:0:23516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c87dd6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130757.614892:0:23516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb4ea0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23516:1876038857818624:192.168.202.10@tcp:104: 00010000:00010000:1.0:1789130757.614935:0:23516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130757.615361:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130757.615574:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834623232 00000100:00100000:1.0:1789130757.615581:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834623232 00010000:00010000:1.0:1789130757.615673:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 6 pid: 23517 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130757.615707:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:1.0:1789130757.615717:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2401:x1876038834623232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130757.615732:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130757.615739:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 6 pid: 23517 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.615752:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 6 pid: 23517 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.615791:0:23502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983000/0x76b2fec9b0509966 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14d97 expref: 6 pid: 23517 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.615806:0:23502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbe200) 00010000:00010000:1.0:1789130757.615811:0:23502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.615822:0:23502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.615831:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789130757.616063:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130757.616709:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130757.617940:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834623232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2215us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.617954:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00010000:00010000:3.0:1789130757.619792:0:23516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.619808:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.619990:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.620004:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.620015:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622419:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622440:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622452:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130757.622468:0:23516:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f5d2562c reply state 000000005a32fb31 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622479:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622485:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:2.0:1789130757.622495:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789130757.622499:0:23516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789130757.622504:0:23516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789130757.622513:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622519:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622527:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622533:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982c00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130757.622537:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622545:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622555:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbe200) 00010000:00010000:2.0:1789130757.622558:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130757.622561:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622568:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b05099d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789130757.622587:0:23516:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f5d2562c reply state 000000005a32fb31 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.622596:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.626635:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e9cb3dbe700) 00010000:00010000:2.0:1789130757.626646:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789130757.626653:0:23516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789130757.627950:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+10:19051:x1876038834623104:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 16988us (17137us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789130757.627963:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 28 10000000:01000000:2.0:1789130757.656732:0:23512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130757.656740:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9cac2da800 from 19 10000000:01000000:2.0:1789130757.656746:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130757.656798:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c8353ee00/0x76b2fec9b05099eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.656811:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9c8353ee00/0x76b2fec9b05099eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.656822:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9c8353ee00/0x76b2fec9b05099eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130757.656854:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857818752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130757.656945:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130757.657008:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb582df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130757.657159:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857818752 00000100:00100000:0.0:1789130757.657169:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857818752 00000100:00100000:0.0:1789130757.657242:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789130757.657252:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+20:23512:x1876038857818752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130757.657265:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130757.657279:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c829d8600/0x76b2fec9b05099f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05099eb expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.657302:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c829d8600/0x76b2fec9b05099f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05099eb expref: 21 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.657328:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c829d8600/0x76b2fec9b05099f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05099eb expref: 21 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.657336:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d8600, rc 0) 00000100:00100000:0.0:1789130757.657383:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857818752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.657390:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789130757.658674:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857818752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130757.658699:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9c8353ee00/0x76b2fec9b05099eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05099f2 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.658711:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9c8353ee00/0x76b2fec9b05099eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b05099f2 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130757.658818:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857818880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130757.658871:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130757.658921:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb582df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130757.658978:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857818880 00000100:00100000:3.0:1789130757.658983:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857818880 00000100:00100000:3.0:1789130757.659028:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789130757.659037:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857818880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.659164:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857818880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130757.659172:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789130757.659204:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857818880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130757.659230:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130757.659272:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130757.659292:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb582df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130757.659344:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857819008 00000100:00100000:1.0:1789130757.659348:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857819008 00000100:00100000:1.0:1789130757.659382:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789130757.659389:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857819008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130757.659472:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857819008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130757.659478:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789130757.659588:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789130757.665723:0:26567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789130757.665901:0:23512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789130757.665925:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130757.665935:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c8353ee00/0x76b2fec9b05099eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05099f2 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.665946:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c8353ee00/0x76b2fec9b05099eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b05099f2 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130757.665957:0:23512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789130757.665960:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9c870ca000 from 19 10000000:01000000:3.0:1789130757.665963:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130757.665999:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f600/0x76b2fec9b05099f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.666007:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f600/0x76b2fec9b05099f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.666025:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f600/0x76b2fec9b05099f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130757.666048:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.666113:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130757.666146:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130757.666224:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857819136 00000100:00100000:0.0:1789130757.666231:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857819136 00000100:00100000:0.0:1789130757.666279:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789130757.666288:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+21:23512:x1876038857819136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130757.666301:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130757.666313:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c829d8c00/0x76b2fec9b0509a00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b05099f9 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.666334:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c829d8c00/0x76b2fec9b0509a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b05099f9 expref: 22 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.666344:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c829d8c00/0x76b2fec9b0509a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b05099f9 expref: 22 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.666352:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d8c00, rc 0) 00000100:00100000:0.0:1789130757.666397:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:23512:x1876038857819136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.666403:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789130757.666522:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130757.666535:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f600/0x76b2fec9b05099f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a00 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.666543:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f600/0x76b2fec9b05099f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509a00 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130757.666594:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130757.666666:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130757.666695:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb582d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130757.666740:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857819264 00000100:00100000:3.0:1789130757.666744:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857819264 00000100:00100000:3.0:1789130757.666774:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789130757.666780:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:23512:x1876038857819264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.666890:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:23512:x1876038857819264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130757.666897:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789130757.666927:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.666956:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.666996:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130757.667008:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130757.667018:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857819392 00000100:00100000:3.0:1789130757.667021:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857819392 00000100:00100000:3.0:1789130757.667036:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789130757.667041:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:23512:x1876038857819392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.667112:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:23512:x1876038857819392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130757.667119:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789130757.667162:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789130757.668087:0:26568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789130757.668254:0:23512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789130757.668278:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130757.668287:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f600/0x76b2fec9b05099f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a00 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.668297:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f600/0x76b2fec9b05099f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a00 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130757.668306:0:23512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789130757.668308:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9b82102800 from 19 10000000:01000000:3.0:1789130757.668311:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130757.668335:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f200/0x76b2fec9b0509a07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.668342:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f200/0x76b2fec9b0509a07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.668351:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f200/0x76b2fec9b0509a07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130757.668369:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.668412:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130757.668448:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130757.668524:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857819520 00000100:00100000:2.0:1789130757.668529:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857819520 00000100:00100000:2.0:1789130757.668559:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789130757.668566:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+22:23512:x1876038857819520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130757.668577:0:23510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130757.668597:0:23510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c8353f600/0x76b2fec9b0509a0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b0509a07 expref: -99 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.668645:0:23510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c8353f600/0x76b2fec9b0509a0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b0509a07 expref: 23 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.668654:0:23510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c8353f600/0x76b2fec9b0509a0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509a07 expref: 23 pid: 23510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.668662:0:23510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353f600, rc 0) 00000100:00100000:2.0:1789130757.668692:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857819520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.668698:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789130757.668767:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130757.668780:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f200/0x76b2fec9b0509a07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a0e expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.668788:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f200/0x76b2fec9b0509a07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509a0e expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130757.668843:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.668887:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130757.668914:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130757.668975:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857819648 00000100:00100000:1.0:1789130757.668980:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857819648 00000100:00100000:1.0:1789130757.669001:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789130757.669007:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857819648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130757.669136:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857819648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130757.669153:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789130757.669236:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.669261:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130757.669297:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130757.669318:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c88d84000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130757.669367:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857819776 00000100:00100000:2.0:1789130757.669371:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857819776 00000100:00100000:2.0:1789130757.669389:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789130757.669394:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb56d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857819776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130757.669476:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb56d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857819776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.669483:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789130757.669729:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c944c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789130757.672232:0:26569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789130757.672451:0:23512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789130757.672474:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130757.672487:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f200/0x76b2fec9b0509a07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a0e expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.672499:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9b8402f200/0x76b2fec9b0509a07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a0e expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130757.672511:0:23512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130757.672530:0:23512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e9cb353d000 from 19 10000000:01000000:2.0:1789130757.672533:0:23512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130757.672571:0:23512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c8353f800/0x76b2fec9b0509a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.672580:0:23512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff9e9c8353f800/0x76b2fec9b0509a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.672592:0:23512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff9e9c8353f800/0x76b2fec9b0509a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130757.672657:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130757.672733:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130757.672771:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c876a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130757.673074:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857819904 00000100:00100000:0.0:1789130757.673089:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857819904 00000100:00100000:0.0:1789130757.673147:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789130757.673158:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c851e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+23:23512:x1876038857819904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130757.673174:0:23508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130757.673198:0:23508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e9c829d9a00/0x76b2fec9b0509a1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x76b2fec9b0509a15 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.673224:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e9c829d9a00/0x76b2fec9b0509a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76b2fec9b0509a15 expref: 24 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.673236:0:23508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e9c829d9a00/0x76b2fec9b0509a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76b2fec9b0509a15 expref: 24 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.673246:0:23508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9a00, rc 0) 00000100:00100000:0.0:1789130757.673303:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c851e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:23512:x1876038857819904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.673311:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789130757.673360:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857819904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130757.673375:0:23512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff9e9c8353f800/0x76b2fec9b0509a15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a1c expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.673385:0:23512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff9e9c8353f800/0x76b2fec9b0509a15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76b2fec9b0509a1c expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130757.673453:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857820032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130757.673479:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130757.673493:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c82adf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130757.673504:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857820032 00000100:00100000:0.0:1789130757.673513:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857820032 00000100:00100000:0.0:1789130757.673531:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789130757.673537:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c851e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:23512:x1876038857820032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130757.673667:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c851e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:23512:x1876038857820032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.673673:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789130757.673700:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857820032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130757.673727:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857820160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130757.673767:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130757.673780:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c9175df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130757.673790:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857820160 00000100:00100000:0.0:1789130757.673794:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857820160 00000100:00100000:0.0:1789130757.673809:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789130757.673815:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:23512:x1876038857820160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130757.673918:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:23512:x1876038857820160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.673935:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789130757.673971:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:23512:1876038857820160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789130757.676396:0:26570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789130757.676653:0:23512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789130757.676683:0:23512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130757.676695:0:23512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff9e9c8353f800/0x76b2fec9b0509a15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a1c expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.676706:0:23512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff9e9c8353f800/0x76b2fec9b0509a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76b2fec9b0509a1c expref: -99 pid: 23512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130757.733414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130757.733495:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834623360 00000100:00100000:2.0:1789130757.733506:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834623360 00000100:00100000:2.0:1789130757.733568:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:2.0:1789130757.733578:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+10:19060:x1876038834623360:12345-192.168.202.10@tcp:101:lctl.0 00010000:00010000:2.0:1789130757.733606:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130757.733670:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14dc1 expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.733736:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ec00/0x76b2fec9b0509a2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.733752:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ec00/0x76b2fec9b0509a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.733764:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ec00/0x76b2fec9b0509a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130757.733863:0:26319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789130757.733867:0:26319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789130757.733907:0:26319:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ec00/0x76b2fec9b0509a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.733933:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dc1 expref: 12 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.733952:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ec00/0x76b2fec9b0509a2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dc1 expref: 11 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.733961:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbef00) 00010000:00010000:2.0:1789130757.733965:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130757.733969:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353ec00, rc 0) 00000100:00100000:2.0:1789130757.734042:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+11:19060:x1876038834623360:12345-192.168.202.10@tcp:101:lctl.0 Request processed in 465us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.734050:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:3.0:1789130757.752243:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130757.752336:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834623488 00000100:00100000:2.0:1789130757.752344:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834623488 00000100:00100000:2.0:1789130757.752395:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:2.0:1789130757.752402:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c944c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:19061:x1876038834623488:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1789130757.752420:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130757.752436:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14dc8 expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.752488:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fc00/0x76b2fec9b0509a38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.752514:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fc00/0x76b2fec9b0509a38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.752524:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fc00/0x76b2fec9b0509a38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130757.752563:0:23517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789130757.752565:0:23517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789130757.752579:0:23517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fc00/0x76b2fec9b0509a38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.752597:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dc8 expref: 7 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.752656:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fc00/0x76b2fec9b0509a38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dc8 expref: 6 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.752662:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbef00) 00010000:00010000:2.0:1789130757.752665:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130757.752667:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353fc00, rc 0) 00000100:00100000:2.0:1789130757.752710:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c944c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:19061:x1876038834623488:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 309us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.752716:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:3.0:1789130757.757017:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130757.757363:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834623616 00000100:00100000:2.0:1789130757.757371:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834623616 00000100:00100000:2.0:1789130757.757411:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:2.0:1789130757.757417:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:19061:x1876038834623616:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1789130757.757434:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130757.757467:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14dcf expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757527:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757538:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757548:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757555:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757559:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757563:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757648:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509a54 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757654:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509a54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757658:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509a54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130757.757690:0:26319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789130757.757693:0:26319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789130757.757708:0:26319:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509a54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757722:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757726:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757731:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757734:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e600 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130757.757737:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757742:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757751:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbef00) 00010000:00010000:2.0:1789130757.757753:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130757.757757:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.757761:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509a46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758074:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758078:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758082:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758090:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e200 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130757.758092:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758096:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758101:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e9cb3dbe700) 00010000:00010000:2.0:1789130757.758103:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130757.758105:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758117:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758137:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dcf expref: 8 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758146:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509a54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dcf expref: 7 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.758150:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:2.0:1789130757.758152:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130757.758153:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353e400, rc 0) 00000100:00100000:2.0:1789130757.758224:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+7:19061:x1876038834623616:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 806us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.758229:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:3.0:1789130757.760413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130757.760981:0:23527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834623744 00000100:00100000:2.0:1789130757.761003:0:23527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834623744 00000100:00100000:2.0:1789130757.761146:0:23527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:2.0:1789130757.761157:0:23527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b8407f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:19061:x1876038834623744:12345-192.168.202.10@tcp:900:lfs.0 00000100:00100000:2.0:1789130757.761275:0:23527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b8407f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:19061:x1876038834623744:12345-192.168.202.10@tcp:900:lfs.0 Request processed in 119us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.761282:0:23527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00080000:1.0:1789130757.761422:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130757.775202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130757.775444:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834624000 00000100:00100000:2.0:1789130757.775454:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834624000 00000100:00100000:2.0:1789130757.775521:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00100000:2.0:1789130757.775536:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5861a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+7:19061:x1876038834624000:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1789130757.775559:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130757.775580:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14dd6 expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130757.776137:0:23517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789130757.776314:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dd6 expref: 9 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.776330:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbef00) 00010000:00010000:3.0:1789130757.776334:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789130757.776340:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509a5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dd6 expref: 9 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.776451:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353fa00, rc 0) 00000100:00100000:3.0:1789130757.776563:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5861a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+8:19061:x1876038834624000:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1030us (1369us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1789130757.776592:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00100000:3.0:1789130757.792445:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130757.794318:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834624256 00000100:00100000:2.0:1789130757.794332:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834624256 00000100:00100000:2.0:1789130757.794411:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:2.0:1789130757.794421:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5862d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+8:19061:x1876038834624256:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:2.0:1789130757.794483:0:26319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130757.794512:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509a54 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14dcf expref: 8 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.794532:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:2.0:1789130757.794537:0:26319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130757.794559:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.794592:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.794604:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130757.795069:0:26319:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000078714441 reply state 000000008fdd6a00 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.795084:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.795092:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:1.0:1789130757.795094:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789130757.795097:0:26319:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789130757.795105:0:26319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789130757.795227:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5862d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:765f1863-470f-4ca5-94b8-b8b93a24bcc1+9:19061:x1876038834624256:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 806us (2790us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1789130757.795235:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:1.0:1789130757.797114:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130757.797208:0:23518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834624512 00000100:00100000:3.0:1789130757.797218:0:23518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834624512 00000100:00100000:3.0:1789130757.797276:0:23518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:3.0:1789130757.797287:0:23518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+9:19061:x1876038834624512:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1789130757.797512:0:23518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+10:19061:x1876038834624512:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 226us (404us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789130757.797520:0:23518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:3.0:1789130757.803290:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130757.803382:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834624768 00000100:00100000:1.0:1789130757.803394:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834624768 00000100:00100000:1.0:1789130757.803465:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:1.0:1789130757.803475:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5860f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+10:19061:x1876038834624768:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1789130757.803516:0:23516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130757.803536:0:23516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983e00/0x76b2fec9b0509a70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14ddd expref: -99 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803606:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803666:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803678:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803692:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803699:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803705:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130757.803834:0:23516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789130757.803914:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803922:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803929:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803946:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982800 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130757.803950:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803958:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803971:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbef00) 00010000:00010000:1.0:1789130757.803974:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130757.803979:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.803986:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982800/0x76b2fec9b0509a77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804000:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804006:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804012:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804016:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83983800 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130757.804018:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804024:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804039:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e9cb3dbe700) 00010000:00010000:1.0:1789130757.804041:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130757.804044:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804050:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983800/0x76b2fec9b0509a7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804087:0:23516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983e00/0x76b2fec9b0509a70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14ddd expref: 12 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804097:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbef00) 00010000:00010000:1.0:1789130757.804099:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130757.804103:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983e00/0x76b2fec9b0509a70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14ddd expref: 12 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.804193:0:23516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83983e00, rc 0) 00000100:00100000:1.0:1789130757.804261:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5860f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+11:19061:x1876038834624768:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 784us (978us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1789130757.804269:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:1.0:1789130757.807155:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.807294:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834624896 00000100:00100000:0.0:1789130757.807304:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834624896 00000100:00100000:0.0:1789130757.807366:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:0.0:1789130757.807376:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+11:19061:x1876038834624896:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1789130757.807401:0:23515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130757.807423:0:23515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509a8c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14de4 expref: -99 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.807544:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.807558:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.807570:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130757.807598:0:23515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789130757.807602:0:23515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789130757.807645:0:23515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.807667:0:23515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509a8c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 13 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.807679:0:23515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 12 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.807685:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:0.0:1789130757.807687:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130757.807689:0:23515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9200, rc 0) 00000100:00100000:0.0:1789130757.807735:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+12:19061:x1876038834624896:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 361us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.807742:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:2.0:1789130757.811728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130757.811977:0:23519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834625024 00000100:00100000:3.0:1789130757.811988:0:23519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834625024 00000100:00100000:3.0:1789130757.812050:0:23519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:3.0:1789130757.812060:0:23519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+12:19061:x1876038834625024:12345-192.168.202.10@tcp:37:lfs.0 00000100:00100000:2.0:1789130757.816730:0:23519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:765f1863-470f-4ca5-94b8-b8b93a24bcc1+12:19061:x1876038834625024:12345-192.168.202.10@tcp:37:lfs.0 Request processed in 4662us (5002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.816740:0:23519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:1.0:1789130757.821059:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.821150:0:23518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834625280 00000100:00100000:0.0:1789130757.821169:0:23518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834625280 00000100:00100000:0.0:1789130757.821258:0:23518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:0.0:1789130757.821268:0:23518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9fa18450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+12:19061:x1876038834625280:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1789130757.821517:0:23518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9fa18450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+13:19061:x1876038834625280:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 249us (468us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789130757.821525:0:23518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:3.0:1789130757.849004:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857820416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130757.849051:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130757.849069:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb5860780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857820288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130757.849090:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130757.849263:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857820416 00000100:00100000:2.0:1789130757.849270:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857820416 00000100:00100000:2.0:1789130757.849331:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789130757.849341:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb58621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857820416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130757.849377:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789130757.849424:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb58621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857820416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.849431:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130757.849519:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857820416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130757.849923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130757.851377:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857820288 00000100:00100000:2.0:1789130757.851391:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857820288 00000100:00100000:2.0:1789130757.851458:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789130757.851468:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857820288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130757.851501:0:23520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789130757.851596:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857820288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.851604:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789130757.855859:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb5860780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857820288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130757.887871:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130757.888232:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834625408 00000100:00100000:2.0:1789130757.888251:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834625408 00000100:00100000:2.0:1789130757.888329:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:2.0:1789130757.888340:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+11:19067:x1876038834625408:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1789130757.888363:0:23516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130757.888385:0:23516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509a9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14deb expref: -99 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.888457:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.888472:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.888484:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.888494:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.888502:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.888509:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.889502:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509aaf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.889532:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509aaf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.889547:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509aaf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130757.889758:0:23516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789130757.889765:0:23516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789130757.889811:0:23516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509aaf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.889826:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.889833:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.889847:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.889857:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e000 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130757.889914:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.889996:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890012:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbef00) 00010000:00010000:2.0:1789130757.890016:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130757.890021:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890034:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509aa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890061:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890089:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890196:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890204:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f000 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130757.890210:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890223:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890238:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e9cb3dbe700) 00010000:00010000:2.0:1789130757.890244:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130757.890249:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890259:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509aa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890374:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509a9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14deb expref: 13 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890389:0:23516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e600/0x76b2fec9b0509aaf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14deb expref: 12 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130757.890395:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:2.0:1789130757.890397:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789130757.890406:0:23516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353e600, rc 0) 00000100:00100000:2.0:1789130757.890485:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+12:19067:x1876038834625408:12345-192.168.202.10@tcp:101:bash.0 Request processed in 2146us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130757.890495:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:2.0:1789130757.895232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130757.895372:0:23526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834625536 00000100:00100000:3.0:1789130757.895384:0:23526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834625536 00000100:00100000:3.0:1789130757.895450:0:23526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1789130757.895461:0:23526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:886c6038-f10d-4040-94e2-570d1de9fb6a+5:19067:x1876038834625536:12345-192.168.202.10@tcp:900:bash.0 00000100:00100000:3.0:1789130757.895594:0:23526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:886c6038-f10d-4040-94e2-570d1de9fb6a+5:19067:x1876038834625536:12345-192.168.202.10@tcp:900:bash.0 Request processed in 132us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130757.895607:0:23526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:1.0:1789130757.900074:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.900151:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834625792 00000100:00100000:0.0:1789130757.900161:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834625792 00000100:00100000:0.0:1789130757.900238:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:0.0:1789130757.900250:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+12:19067:x1876038834625792:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1789130757.900288:0:23515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130757.900316:0:23515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509ab6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14df2 expref: -99 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.900451:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.900469:0:23515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 12 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.900479:0:23515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.900514:0:23515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 12 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.900530:0:23515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 12 pid: 23515 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130757.900566:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23515:1876038857820544:192.168.202.10@tcp:104: 00000100:00100000:0.0:1789130757.900676:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c82adfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130757.906527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.906830:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23515:1876038857820544:192.168.202.10@tcp:104: 00010000:00010000:0.0:1789130757.906862:0:23515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130757.910384:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834625920 00000100:00100000:2.0:1789130757.910403:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834625920 00010000:00010000:0.0:1789130757.910554:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 13 pid: 23515 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130757.910601:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:0.0:1789130757.910630:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+13:2402:x1876038834625920:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130757.910646:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130757.910654:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 13 pid: 23515 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.910668:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 13 pid: 23515 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.910692:0:23500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509a93 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14de4 expref: 13 pid: 23515 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.910709:0:23500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:0.0:1789130757.910714:0:23500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.910744:0:23500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.910753:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130757.910786:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130757.910944:0:23515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.910953:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.911014:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.911025:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.911033:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130757.913386:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+12:2402:x1876038834625920:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2762us (6857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130757.913404:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00010000:00010000:1.0:1789130757.913984:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914002:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914014:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130757.914027:0:23515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789130757.914054:0:23515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914062:0:23515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914088:0:23515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914094:0:23515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d8a00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130757.914099:0:23515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914108:0:23515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914122:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:1.0:1789130757.914125:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130757.914130:0:23515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914136:0:23515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8a00/0x76b2fec9b0509abd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130757.914151:0:23515:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f81c6bd5 reply state 000000008461ff45 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914162:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914169:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e9cb3e93a00) 00010000:00010000:1.0:1789130757.914171:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789130757.914183:0:23515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130757.914222:0:23515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509ab6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 15 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914238:0:23515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 14 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130757.914252:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:1.0:1789130757.914255:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789130757.914257:0:23515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83982200, rc 0) 00000100:00100000:1.0:1789130757.914433:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+15:19067:x1876038834625792:12345-192.168.202.10@tcp:101:bash.0 Request processed in 14185us (14368us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789130757.914441:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:2.0:1789130757.928344:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130757.928423:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834626048 00000100:00100000:3.0:1789130757.928434:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834626048 00000100:00100000:3.0:1789130757.928492:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:3.0:1789130757.928503:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+15:19067:x1876038834626048:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:3.0:1789130757.928530:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130757.928551:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509ad9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14df9 expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.928659:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.928673:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.928685:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130757.928730:0:23517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789130757.928734:0:23517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789130757.928755:0:23517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.928765:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.928789:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509ad9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 17 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.928806:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 16 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130757.928835:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:3.0:1789130757.928837:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789130757.928841:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b8402fe00, rc 0) 00000100:00100000:3.0:1789130757.928907:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+16:19067:x1876038834626048:12345-192.168.202.10@tcp:101:bash.0 Request processed in 406us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130757.928914:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:1.0:1789130757.933978:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130757.934388:0:23518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834626304 00000100:00100000:0.0:1789130757.934405:0:23518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834626304 00000100:00100000:0.0:1789130757.934467:0:23518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:0.0:1789130757.934475:0:23518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb4ea0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+16:19067:x1876038834626304:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:0.0:1789130757.934759:0:23518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb4ea0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+17:19067:x1876038834626304:12345-192.168.202.10@tcp:35:bash.0 Request processed in 284us (790us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1789130757.934766:0:23518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000040:00080000:2.0:1789130757.977474:0:24277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789130757.977475:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789130758.019709:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.020059:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834626560 00000100:00100000:2.0:1789130758.020069:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834626560 00000100:00100000:2.0:1789130758.020170:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:2.0:1789130758.020189:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+17:19077:x1876038834626560:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1789130758.020218:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130758.020239:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509ae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e00 expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130758.020353:0:26319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789130758.020455:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509ae7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e00 expref: 19 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.020470:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e9cb3dbef00) 00010000:00010000:2.0:1789130758.020473:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130758.020479:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509ae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e00 expref: 19 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.020495:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353f000, rc 0) 00000100:00100000:2.0:1789130758.020659:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+18:19077:x1876038834626560:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 471us (959us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1789130758.020685:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:3.0:1789130758.023762:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130758.023938:0:23518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834626816 00000100:00100000:1.0:1789130758.023949:0:23518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834626816 00000100:00100000:1.0:1789130758.024019:0:23518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1789130758.024029:0:23518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5861680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+18:19077:x1876038834626816:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1789130758.025292:0:23518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5861680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+19:19077:x1876038834626816:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 1258us (1536us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789130758.025304:0:23518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:3.0:1789130758.109064:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130758.109360:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834627072 00000100:00100000:0.0:1789130758.109370:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834627072 00000100:00100000:0.0:1789130758.109438:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:0.0:1789130758.109448:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5863c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+19:19080:x1876038834627072:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1789130758.109474:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130758.109495:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509af5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e07 expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.109602:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509afc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.109675:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509afc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.109688:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509afc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130758.109700:0:23517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789130758.109809:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509af5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e07 expref: 22 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.109828:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509afc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e07 expref: 21 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.109836:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:0.0:1789130758.109839:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130758.109842:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9c00, rc 0) 00000100:00100000:0.0:1789130758.109905:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5863c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+21:19080:x1876038834627072:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 458us (852us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1789130758.109913:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:0.0:1789130758.115333:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130758.115427:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834627200 00000100:00100000:1.0:1789130758.115438:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834627200 00000100:00100000:1.0:1789130758.115499:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:1.0:1789130758.115508:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+21:19080:x1876038834627200:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:1.0:1789130758.115574:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115593:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115670:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115706:0:23515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115714:0:23515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115721:0:23515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115728:0:23515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982a00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130758.115732:0:23515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115741:0:23515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115754:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:1.0:1789130758.115757:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130758.115762:0:23515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.115768:0:23515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982a00/0x76b2fec9b0509b0a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130758.115835:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+21:19080:x1876038834627200:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 327us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130758.115843:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:1.0:1789130758.120253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.120687:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834627328 00000100:00100000:2.0:1789130758.120699:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834627328 00000100:00100000:2.0:1789130758.120770:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:2.0:1789130758.120780:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+21:2400:x1876038834627328:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130758.120796:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130758.120821:0:23502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509afc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e07 expref: 21 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.120839:0:23502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130758.120844:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130758.120913:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+20:2400:x1876038834627328:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 134us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130758.120921:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:3.0:1789130758.129796:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.129895:0:23519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834627584 00000100:00100000:2.0:1789130758.129905:0:23519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834627584 00000100:00100000:2.0:1789130758.129978:0:23519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:2.0:1789130758.129989:0:23519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5860b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+20:19080:x1876038834627584:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:2.0:1789130758.130297:0:23519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5860b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+21:19080:x1876038834627584:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 309us (511us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789130758.130306:0:23519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1789130758.442080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130758.442196:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834627840 00000100:00100000:0.0:1789130758.442204:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834627840 00000100:00100000:0.0:1789130758.442260:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:0.0:1789130758.442270:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb58612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+21:19111:x1876038834627840:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1789130758.442294:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130758.442313:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b11 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e0e expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.442415:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b18 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.442425:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.442435:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130758.442442:0:23517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789130758.442557:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b11 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e0e expref: 24 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.442576:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b18 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e0e expref: 23 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.442582:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:0.0:1789130758.442584:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789130758.442586:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9c00, rc 0) 00000100:00100000:0.0:1789130758.442679:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb58612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+23:19111:x1876038834627840:12345-192.168.202.10@tcp:101:cat.0 Request processed in 412us (608us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1789130758.442684:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:3.0:1789130758.449259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130758.449308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.449409:0:23519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834628096 00000100:00100000:2.0:1789130758.449422:0:23519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834628096 00000100:00100000:2.0:1789130758.449504:0:23519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:2.0:1789130758.449514:0:23519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+23:19111:x1876038834628096:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:2.0:1789130758.449870:0:23519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+24:19111:x1876038834628096:12345-192.168.202.10@tcp:35:cat.0 Request processed in 355us (622us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789130758.449886:0:23519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:0.0:1789130758.450276:0:23501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834628224 00000100:00100000:0.0:1789130758.450282:0:23501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834628224 00000100:00100000:0.0:1789130758.450328:0:23501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:0.0:1789130758.450336:0:23501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb58630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+24:2402:x1876038834628224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130758.450348:0:23501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130758.450382:0:23501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b18 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e0e expref: 24 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.450401:0:23501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:0.0:1789130758.450407:0:23501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130758.450489:0:23501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb58630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+23:2402:x1876038834628224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 154us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130758.450498:0:23501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:3.0:1789130758.525718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130758.525847:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834628480 00000100:00100000:1.0:1789130758.525858:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834628480 00000100:00100000:1.0:1789130758.525933:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:1.0:1789130758.525944:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb58603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+23:19117:x1876038834628480:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:1.0:1789130758.525972:0:23515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130758.525996:0:23515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983600/0x76b2fec9b0509b26 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e15 expref: -99 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.526099:0:23515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.526111:0:23515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 24 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.526117:0:23515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 24 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.526123:0:23515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.526155:0:23515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 24 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.526181:0:23515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 24 pid: 23517 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130758.526197:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23515:1876038857820672:192.168.202.10@tcp:104: 00010000:00010000:1.0:1789130758.526313:0:23515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 24 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.526339:0:23515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 24 pid: 23515 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130758.526348:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23515:1876038857820800:192.168.202.10@tcp:104: 00000100:00100000:1.0:1789130758.526446:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3ee4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130758.528969:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23515:1876038857820672:192.168.202.10@tcp:104: 00000100:00100000:3.0:1789130758.529426:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130758.529512:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23515:1876038857820800:192.168.202.10@tcp:104: 00010000:00010000:1.0:1789130758.529547:0:23515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130758.529786:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834628608 00000100:00100000:0.0:1789130758.529794:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834628608 00010000:00010000:0.0:1789130758.529838:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 25 pid: 23515 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130758.529886:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:0.0:1789130758.529896:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5862580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+25:2400:x1876038834628608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130758.529910:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130758.529918:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 25 pid: 23515 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.529938:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 25 pid: 23515 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.529962:0:23500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982200/0x76b2fec9b0509acb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df2 expref: 25 pid: 23515 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.529978:0:23500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:0.0:1789130758.529983:0:23500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.530006:0:23500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.530013:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130758.530066:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5862580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+24:2400:x1876038834628608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 171us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130758.530074:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:3.0:1789130758.532333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.532565:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834628736 00000100:00100000:2.0:1789130758.532575:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834628736 00010000:00010000:2.0:1789130758.532650:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 24 pid: 23517 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130758.532693:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:2.0:1789130758.532704:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cac765450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+24:2401:x1876038834628736:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130758.532721:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130758.532729:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 24 pid: 23517 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.532741:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 24 pid: 23517 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.532763:0:23502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402fe00/0x76b2fec9b0509ae0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14df9 expref: 24 pid: 23517 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.532780:0:23502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130758.532786:0:23502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.532797:0:23502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.532806:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.532980:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130758.533029:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cac765450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+23:2401:x1876038834628736:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 326us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130758.533038:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00010000:00010000:1.0:1789130758.534422:0:23515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.534435:0:23515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130758.534514:0:23515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789130758.534796:0:23515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983600/0x76b2fec9b0509b26 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e15 expref: 24 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.534816:0:23515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982e00/0x76b2fec9b0509b2d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e15 expref: 23 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130758.534825:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:1.0:1789130758.534827:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130758.534831:0:23515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83982e00, rc 0) 00000100:00100000:1.0:1789130758.535069:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb58603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+23:19117:x1876038834628480:12345-192.168.202.10@tcp:101:dd.0 Request processed in 9125us (9358us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1789130758.535078:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:3.0:1789130758.538422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130758.538504:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834628864 00000100:00100000:0.0:1789130758.538514:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834628864 00000100:00100000:0.0:1789130758.538574:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:0.0:1789130758.538583:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5861e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+23:19117:x1876038834628864:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:0.0:1789130758.538609:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130758.538672:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b3b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e1c expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.538706:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.538721:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.538732:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.538851:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b3b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 25 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.538866:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 24 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.538886:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:0.0:1789130758.538888:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130758.538891:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9000, rc 0) 00000100:00100000:0.0:1789130758.538940:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5861e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+24:19117:x1876038834628864:12345-192.168.202.10@tcp:101:dd.0 Request processed in 359us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130758.538945:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:3.0:1789130758.543945:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.544033:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834629120 00000100:00100000:2.0:1789130758.544043:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834629120 00000100:00100000:2.0:1789130758.544100:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:2.0:1789130758.544110:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5863840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+24:19117:x1876038834629120:12345-192.168.202.10@tcp:36:dd.0 00010000:00010000:2.0:1789130758.544376:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.544394:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.544407:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130758.544451:0:26319:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789130758.544474:0:26319:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000005f3f567 reply state 00000000c3dd6337 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.544492:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.544500:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130758.544503:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789130758.544506:0:26319:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789130758.544603:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5863840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+27:19117:x1876038834629120:12345-192.168.202.10@tcp:36:dd.0 Request processed in 494us (665us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789130758.544646:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 45 00000020:00080000:2.0:1789130758.544651:0:26319:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789130758.546986:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130758.547063:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834629248 00000100:00100000:0.0:1789130758.547072:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834629248 00000100:00100000:0.0:1789130758.547126:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:0.0:1789130758.547136:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+27:19117:x1876038834629248:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:0.0:1789130758.547165:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130758.547194:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b50 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e23 expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.547248:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b50 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e23 expref: 28 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.547263:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b50 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e23 expref: 28 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130758.547281:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:0.0:1789130758.547285:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130758.547289:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9c00, rc 0) 00000100:00100000:0.0:1789130758.547348:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+28:19117:x1876038834629248:12345-192.168.202.10@tcp:101:dd.0 Request processed in 212us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130758.547355:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 46 00010000:00010000:2.0:1789130758.552860:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130758.558746:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.558858:0:23501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834629504 00000100:00100000:2.0:1789130758.558868:0:23501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834629504 00000100:00100000:2.0:1789130758.558959:0:23501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:2.0:1789130758.558968:0:23501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5862940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+28:19117:x1876038834629504:12345-192.168.202.10@tcp:103:dd.0 00010000:00010000:2.0:1789130758.558983:0:23501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130758.559014:0:23501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9c00/0x76b2fec9b0509b50 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e23 expref: 28 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.559034:0:23501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130758.559039:0:23501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130758.559098:0:23501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5862940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+27:19117:x1876038834629504:12345-192.168.202.10@tcp:103:dd.0 Request processed in 131us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130758.559106:0:23501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:3.0:1789130758.562696:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.562775:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834629632 00000100:00100000:2.0:1789130758.562787:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834629632 00000100:00100000:2.0:1789130758.562855:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:2.0:1789130758.562866:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb58630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+27:19117:x1876038834629632:12345-192.168.202.10@tcp:58:dd.0 00010000:00010000:2.0:1789130758.562999:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.563014:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.563028:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789130758.563954:0:26319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130758.563987:0:26319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1789130758.564124:0:26319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1789130758.564266:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb58630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+27:19117:x1876038834629632:12345-192.168.202.10@tcp:58:dd.0 Request processed in 1398us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130758.564275:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:3.0:1789130758.566225:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130758.566340:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834629760 00000100:00100000:2.0:1789130758.566348:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834629760 00000100:00100000:2.0:1789130758.566401:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:2.0:1789130758.566410:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5862580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+27:19117:x1876038834629760:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:2.0:1789130758.566430:0:23516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130758.566450:0:23516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e2a expref: -99 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.566498:0:23516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.566508:0:23516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e2a expref: 28 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.566526:0:23516:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.566539:0:23516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e2a expref: 28 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.566552:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130758.566565:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789130758.566570:0:23516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e2a expref: 28 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130758.566578:0:23516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353ea00, rc 0) 00000100:00100000:2.0:1789130758.566640:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5862580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+28:19117:x1876038834629760:12345-192.168.202.10@tcp:101:dd.0 Request processed in 231us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130758.566647:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 48 00000040:00080000:1.0:1789130759.001729:0:23551:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789130759.001741:0:23551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789130759.001771:0:23551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789130759.001781:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789130759.001925:0:23551:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9c9441f0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23551:1876038857820928:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789130759.002028:0:23551:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3ee4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130759.006103:0:23551:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9c9441f0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23551:1876038857820928:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789130759.015833:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130759.018037:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834629888 00000100:00100000:1.0:1789130759.018054:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834629888 00000100:00100000:1.0:1789130759.018159:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:1.0:1789130759.018179:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5860780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+28:19119:x1876038834629888:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789130759.018211:0:23515:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789130759.018341:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5860780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+28:19119:x1876038834629888:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 165us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130759.018349:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00080000:0.0:1789130759.018465:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130759.021750:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130759.021983:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834630016 00000100:00100000:3.0:1789130759.021994:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834630016 00000100:00100000:3.0:1789130759.022570:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:3.0:1789130759.022583:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+28:19119:x1876038834630016:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789130759.022693:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022713:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022726:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022781:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022789:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022796:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022819:0:23516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022829:0:23516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022836:0:23516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130759.022898:0:23516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789130759.022902:0:23516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789130759.022918:0:23516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022930:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022942:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022949:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022955:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e400 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:3.0:1789130759.022960:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022968:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022981:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9cbc5f1000) 00010000:00010000:3.0:1789130759.022984:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130759.022989:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.022995:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e400/0x76b2fec9b0509b65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023020:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023027:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023758:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023765:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e800 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:3.0:1789130759.023779:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023788:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023799:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9e9cbc119100) 00010000:00010000:3.0:1789130759.023802:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130759.023806:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023812:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e800/0x76b2fec9b0509b6c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023829:0:23516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023836:0:23516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023842:0:23516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023848:0:23516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b8402e600 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:3.0:1789130759.023851:0:23516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023857:0:23516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023865:0:23516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:3.0:1789130759.023867:0:23516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130759.023877:0:23516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130759.023883:0:23516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b8402e600/0x76b2fec9b0509b73 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130759.023981:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+28:19119:x1876038834630016:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 Request processed in 1398us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130759.023991:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:1.0:1789130759.036309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.036396:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834630272 00000100:00100000:2.0:1789130759.036405:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834630272 00000100:00100000:2.0:1789130759.036461:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:2.0:1789130759.036473:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+28:19119:x1876038834630272:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130759.036504:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130759.036526:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509b7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e31 expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036664:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036681:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036694:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130759.036708:0:26319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789130759.036793:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036818:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036825:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036831:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f000 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130759.036835:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036844:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036856:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130759.036859:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130759.036864:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036869:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b81 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036913:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509b7a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e31 expref: 30 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036924:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e9cbc5f1000) 00010000:00010000:2.0:1789130759.036927:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789130759.036930:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509b7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e31 expref: 30 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.036939:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353fe00, rc 0) 00000100:00100000:2.0:1789130759.037008:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+29:19119:x1876038834630272:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 537us (708us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1789130759.037016:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:1.0:1789130759.041843:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.042071:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834630400 00000100:00100000:0.0:1789130759.042082:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834630400 00000100:00100000:0.0:1789130759.042138:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:0.0:1789130759.042148:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+29:19119:x1876038834630400:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789130759.042194:0:23517:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789130759.042314:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+29:19119:x1876038834630400:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 167us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.042323:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:3.0:1789130759.054125:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.054248:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834630656 00000100:00100000:2.0:1789130759.054258:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834630656 00000100:00100000:2.0:1789130759.054322:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:2.0:1789130759.054334:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+29:19119:x1876038834630656:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130759.054356:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130759.054376:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509b8f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e38 expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130759.054852:0:26319:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:2.0:1789130759.054859:0:26319:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1789130759.054880:0:26319:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1789130759.055045:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b96 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.055062:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b96 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.055073:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b96 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.055126:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509b8f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e38 expref: 32 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.055145:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b96 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e38 expref: 31 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.055181:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3dbe600) 00010000:00010000:2.0:1789130759.055185:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789130759.055189:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353f000, rc 0) 00000100:00100000:2.0:1789130759.055258:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+31:19119:x1876038834630656:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 926us (1141us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1789130759.055266:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:1.0:1789130759.059866:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.059955:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834630912 00000100:00100000:0.0:1789130759.059964:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834630912 00000100:00100000:0.0:1789130759.060016:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 54 00000100:00100000:0.0:1789130759.060023:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+31:19119:x1876038834630912:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130759.060080:0:23517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130759.060107:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f000/0x76b2fec9b0509b96 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e38 expref: 31 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060126:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3dbe600) 00010000:00010000:0.0:1789130759.060138:0:23517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130759.060172:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060187:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060197:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060211:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060239:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060246:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060302:0:23517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060307:0:23517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060311:0:23517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060315:0:23517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9200 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:0.0:1789130759.060318:0:23517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060322:0:23517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060327:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:0.0:1789130759.060329:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130759.060332:0:23517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060335:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509ba4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060340:0:23517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060349:0:23517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060353:0:23517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060356:0:23517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9e00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:0.0:1789130759.060357:0:23517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060361:0:23517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060365:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x14267ce1 (ffff9e9cbc5f1800) 00010000:00010000:0.0:1789130759.060366:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130759.060368:0:23517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.060371:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bab lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x14267ce1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130759.060437:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+30:19119:x1876038834630912:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 414us (580us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130759.060452:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 54 00000100:00100000:3.0:1789130759.070991:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130759.071158:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834631040 00000100:00100000:1.0:1789130759.071177:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834631040 00000100:00100000:1.0:1789130759.071242:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:1.0:1789130759.071253:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5995e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+30:19119:x1876038834631040:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789130759.071285:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130759.071323:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983c00/0x76b2fec9b0509bb2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e3f expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.071357:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983a00/0x76b2fec9b0509bb9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.071367:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983a00/0x76b2fec9b0509bb9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.071376:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983a00/0x76b2fec9b0509bb9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.071479:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983c00/0x76b2fec9b0509bb2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e3f expref: 32 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.071492:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83983a00/0x76b2fec9b0509bb9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e3f expref: 31 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.071499:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:1.0:1789130759.071501:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789130759.071503:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9b83983a00, rc 0) 00000100:00100000:1.0:1789130759.071554:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5995e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+31:19119:x1876038834631040:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 304us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130759.071559:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:2.0:1789130759.075524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.075734:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834631296 00000100:00100000:0.0:1789130759.075745:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834631296 00000100:00100000:0.0:1789130759.075811:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 56 00000100:00100000:0.0:1789130759.075823:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+31:19119:x1876038834631296:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130759.075911:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.075943:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.075956:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789130759.076500:0:23517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1789130759.076513:0:23517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777898899003ns, next at 778898895585ns, rc = 0 00000004:00010000:0.0:1789130759.076569:0:23517:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000066be99e7 reply state 00000000a4f36539 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.076584:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.076593:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:0.0:1789130759.076597:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789130759.076601:0:23517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130759.076800:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+33:19119:x1876038834631296:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 978us (1284us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789130759.076809:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 56 00000100:00100000:3.0:1789130759.080742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.081013:0:23515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834631424 00000100:00100000:0.0:1789130759.081024:0:23515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834631424 00000100:00100000:0.0:1789130759.081083:0:23515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:0.0:1789130759.081094:0:23515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+33:19119:x1876038834631424:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130759.081119:0:23515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130759.081140:0:23515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e46 expref: -99 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.081239:0:23515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 34 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.081450:0:23515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 34 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.081473:0:23515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:0.0:1789130759.081477:0:23515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789130759.081481:0:23515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9200, rc 0) 00000100:00100000:0.0:1789130759.081552:0:23515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+34:19119:x1876038834631424:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 460us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.081561:0:23515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:3.0:1789130759.085720:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.086194:0:26092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834631552 00000100:00100000:0.0:1789130759.086204:0:26092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834631552 00000100:00100000:0.0:1789130759.086299:0:26092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:0.0:1789130759.086311:0:26092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2399:x1876038834631552:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789130759.086541:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130759.086882:0:26092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2399:x1876038834631552:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 572us (1171us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1789130759.086891:0:26092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:2.0:1789130759.107056:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130759.107222:0:23519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834631808 00000100:00100000:3.0:1789130759.107233:0:23519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834631808 00000100:00100000:3.0:1789130759.107293:0:23519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:3.0:1789130759.107304:0:23519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+34:19119:x1876038834631808:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789130759.107699:0:23519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+35:19119:x1876038834631808:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 395us (653us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1789130759.107708:0:23519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:3.0:1789130759.110584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.110713:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834632064 00000100:00100000:2.0:1789130759.110723:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834632064 00000100:00100000:2.0:1789130759.110790:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 58 00000100:00100000:2.0:1789130759.110800:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+35:19119:x1876038834632064:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130759.110918:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+35:19119:x1876038834632064:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 120us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130759.110927:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 58 00000100:00100000:1.0:1789130759.115728:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.116833:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834632192 00000100:00100000:2.0:1789130759.116848:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834632192 00000100:00100000:2.0:1789130759.116921:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:2.0:1789130759.116932:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9441d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+35:19119:x1876038834632192:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130759.116956:0:26319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130759.116984:0:26319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bce lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e4d expref: -99 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.117070:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509bd5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.117103:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509bd5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.117116:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509bd5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130759.117175:0:26319:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789130759.117198:0:26319:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509bd5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.117234:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bce lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e4d expref: 37 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.117258:0:26319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509bd5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e4d expref: 36 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.117268:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:2.0:1789130759.117271:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789130759.117275:0:26319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353e400, rc 0) 00000100:00100000:2.0:1789130759.117347:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9441d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+36:19119:x1876038834632192:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 416us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130759.117355:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:3.0:1789130759.124068:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.125459:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834632320 00000100:00100000:2.0:1789130759.125471:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834632320 00000100:00100000:2.0:1789130759.125539:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:2.0:1789130759.125549:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5995a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+6:2402:x1876038834632320:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789130759.125572:0:25342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130759.125640:0:25342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e54 expref: -99 pid: 25342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789130759.125668:0:25342:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f807, blocks: 0x0 00010000:00010000:2.0:1789130759.125691:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=777s v=(0 0) 00010000:00010000:2.0:1789130759.125696:0:25342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130759.125707:0:25342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 7 pid: 25342 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.125729:0:25342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 7 pid: 25342 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.125745:0:25342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c8353fe00, rc 0) 00000100:00100000:2.0:1789130759.125828:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5995a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2402:x1876038834632320:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 279us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130759.125836:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:3.0:1789130759.139152:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.139587:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834632576 00000100:00100000:2.0:1789130759.139597:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834632576 00000100:00100000:2.0:1789130759.139777:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:2.0:1789130759.139787:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5996d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+36:19119:x1876038834632576:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789130759.139905:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5996d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:886c6038-f10d-4040-94e2-570d1de9fb6a+36:19119:x1876038834632576:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 119us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130759.139913:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:1.0:1789130759.147724:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.147895:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834632704 00000100:00100000:2.0:1789130759.147906:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834632704 00000100:00100000:2.0:1789130759.147970:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:2.0:1789130759.147980:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5871680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+36:19119:x1876038834632704:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789130759.153014:0:23495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1789130759.153040:0:23495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789130759.153089:0:23495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1789130759.153399:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.153432:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.153439:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.153456:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e200 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130759.153460:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.153468:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.153482:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:1.0:1789130759.153485:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789130759.153489:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.153495:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e200/0x76b2fec9b0509a69 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130759.153817:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5871680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+19:19119:x1876038834632704:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 Request processed in 5830us (6094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130759.153829:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:1.0:1789130759.157597:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130759.157665:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857821056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789130759.157749:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130759.157801:0:25029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857821056 00000100:00100000:1.0:1789130759.157809:0:25029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857821056 00000100:00100000:1.0:1789130759.157875:0:25029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130759.157885:0:25029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cabc2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876038857821056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789130759.158016:0:25029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789130759.158035:0:25029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789130759.158037:0:25029:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789130759.158040:0:25029:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789130759 -> 1789130759 00002000:00010000:1.0:1789130759.158042:0:25029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789130759.158083:0:25029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cabc2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876038857821056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (334us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1789130759.158092:0:25029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789130759.158244:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789130759.158288:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e9b83aae940/2, rc 0, transno 12884901892 00000100:00100000:1.0:1789130759.158295:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876038857821056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789130759.160216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.160589:0:26092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834632832 00000100:00100000:0.0:1789130759.160599:0:26092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834632832 00000100:00100000:0.0:1789130759.160681:0:26092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:0.0:1789130759.160691:0:26092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2399:x1876038834632832:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789130759.160792:0:26092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2399:x1876038834632832:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 Request processed in 102us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.160813:0:26092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 26 00010000:00010000:1.0:1789130759.161020:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161040:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161048:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161055:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f200 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130759.161059:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161068:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161084:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e9cb3dbe700) 00010000:00010000:1.0:1789130759.161088:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130759.161093:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161109:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f200/0x76b2fec9b05099dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161132:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161138:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161143:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161148:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f400 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130759.161151:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161156:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161176:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e9cb3dbee00) 00010000:00010000:1.0:1789130759.161178:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130759.161181:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161186:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353f400/0x76b2fec9b05099e4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161199:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161204:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161218:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161223:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982c00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130759.161236:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161243:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161253:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e9cb3e93a00) 00010000:00010000:1.0:1789130759.161255:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130759.161258:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161264:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9b83982c00/0x76b2fec9b0509ac4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161280:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161286:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161292:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161297:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e000 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130759.161300:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161317:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161326:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:1.0:1789130759.161328:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130759.161331:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161336:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e000/0x76b2fec9b0509b49 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161348:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161353:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161358:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161363:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9e00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130759.161366:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161371:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161378:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:1.0:1789130759.161380:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130759.161382:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.161396:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9e00/0x76b2fec9b0509bc0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130759.161916:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130759.162060:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130759.162085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130759.162103:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130759.162119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130759.162146:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1789130759.162178:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.162396:0:23508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834632960 00000100:00100000:0.0:1789130759.162404:0:23508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834632960 00000100:00100000:0.0:1789130759.162460:0:23508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 167 00000100:00100000:0.0:1789130759.162471:0:23508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:2401:x1876038834632960:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1789130759.162529:0:23508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1208214-416c-40c9-b997-874a76bc0c4a+13:2401:x1876038834632960:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 61us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.162536:0:23508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 167 00000100:00100000:0.0:1789130759.162568:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834633216 00000100:00100000:0.0:1789130759.162572:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834633216 00000100:00100000:0.0:1789130759.162605:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834633728 00000100:00100000:0.0:1789130759.162607:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834633728 00000100:00100000:0.0:1789130759.162650:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834633600 00000100:00100000:0.0:1789130759.162653:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834633600 00000100:00100000:0.0:1789130759.162670:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:0.0:1789130759.162676:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834633216:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1789130759.162705:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834633216:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.162712:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:0.0:1789130759.162724:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:0.0:1789130759.162730:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb59961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834633728:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1789130759.162753:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb59961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834633728:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 23us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.162759:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:0.0:1789130759.162770:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:0.0:1789130759.162784:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5994b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834633600:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1789130759.162810:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5994b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834633600:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.162815:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00080000:0.0:1789130759.162831:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130759.162835:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130759.162846:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834633472 00000100:00100000:0.0:1789130759.162849:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834633472 00000100:00100000:0.0:1789130759.162875:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834633088 00000100:00100000:0.0:1789130759.162878:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834633088 00000100:00100000:0.0:1789130759.162890:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834633344 00000100:00100000:0.0:1789130759.162893:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834633344 00000100:00100000:0.0:1789130759.162906:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:0.0:1789130759.162912:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5994780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834633472:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1789130759.162940:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5994780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+5:2401:x1876038834633472:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 28us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.162946:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:0.0:1789130759.162958:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:0.0:1789130759.162964:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5995680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834633088:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1789130759.162985:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5995680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2401:x1876038834633088:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 22us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.162991:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:0.0:1789130759.163002:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:0.0:1789130759.163008:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2401:x1876038834633344:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1789130759.163048:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:765f1863-470f-4ca5-94b8-b8b93a24bcc1+6:2401:x1876038834633344:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 40us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.163062:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00080000:0.0:1789130759.163079:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130759.163082:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130759.175840:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.175975:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834633984 00000100:00100000:0.0:1789130759.175989:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834633984 00000100:00100000:0.0:1789130759.176072:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00100000:0.0:1789130759.176083:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb59952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+15:19119:x1876038834633984:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789130759.176153:0:23517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130759.176202:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509bd5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e4d expref: 15 pid: 26319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.176223:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:0.0:1789130759.176229:0:23517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130759.176270:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b0509be3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.176285:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b0509be3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.176296:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b0509be3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130759.176436:0:23517:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a50669ac reply state 0000000065218da4 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b0509be3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.176451:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d8000/0x76b2fec9b0509be3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.176457:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:0.0:1789130759.176479:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789130759.176482:0:23517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789130759.176690:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb59952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+16:19119:x1876038834633984:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 609us (863us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1789130759.176698:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00100000:1.0:1789130759.182727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.182826:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834634112 00000100:00100000:0.0:1789130759.182839:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834634112 00000100:00100000:0.0:1789130759.182910:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:0.0:1789130759.182921:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5873c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+7:19119:x1876038834634112:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130759.182942:0:25026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130759.182962:0:25026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e5b expref: -99 pid: 25026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.182996:0:25026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 8 pid: 25342 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.183007:0:25026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789130759.183011:0:25026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130759.183017:0:25026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 8 pid: 25026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.183070:0:25026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 8 pid: 25342 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.183087:0:25026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 8 pid: 25342 timeout: 878 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130759.183122:0:25026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aacb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:25026:1876038857821184:192.168.202.10@tcp:104: 00000100:00100000:0.0:1789130759.183223:0:25026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cad70b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130759.186943:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.187030:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834634240 00000100:00100000:2.0:1789130759.187039:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834634240 00010000:00010000:2.0:1789130759.187082:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 9 pid: 25342 timeout: 878 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130759.187132:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:2.0:1789130759.187143:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5870b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+9:2401:x1876038834634240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130759.187158:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130759.187191:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 9 pid: 25342 timeout: 878 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.187206:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 9 pid: 25342 timeout: 878 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.187247:0:23502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130759.187257:0:23502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130759.187265:0:23502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 9 pid: 25026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.187295:0:23502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 9 pid: 25026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.187337:0:23502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 9 pid: 25026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130759.187354:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:23502:1876038857821312:192.168.202.10@tcp:105: 00000100:00100000:2.0:1789130759.187828:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c876a16c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789130759.188355:0:25026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002672682e/0x76b2fec9b0509bdc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e54 expref: 9 pid: 25342 timeout: 878 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130759.188371:0:25026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aacb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:25026:1876038857821184:192.168.202.10@tcp:104: 00010000:00010000:0.0:1789130759.188393:0:25026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 8 pid: 25026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.188404:0:25026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9600, rc 0) 00000100:00100000:0.0:1789130759.188453:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5873c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+8:19119:x1876038834634112:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 5534us (5737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.188461:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:2.0:1789130759.200269:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:23502:1876038857821312:192.168.202.10@tcp:105: 00010000:00010000:2.0:1789130759.200299:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130759.200359:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5870b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2401:x1876038834634240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 13217us (13424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130759.200371:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:1.0:1789130759.207648:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.207817:0:25342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834634368 00000100:00100000:2.0:1789130759.207827:0:25342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834634368 00000100:00100000:2.0:1789130759.207888:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:2.0:1789130759.207897:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb58712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2401:x1876038834634368:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789130759.208142:0:25342:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789130759.208146:0:25342:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789130759 00002000:00010000:2.0:1789130759.208148:0:25342:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789130758 00002000:00010000:2.0:1789130759.208151:0:25342:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789130759 -> 1789130759 00002000:00010000:2.0:1789130759.208153:0:25342:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789130759.208220:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb58712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+8:2401:x1876038834634368:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 324us (617us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789130759.208334:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:1.0:1789130759.213692:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.214059:0:25029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834634496 00000100:00100000:2.0:1789130759.214070:0:25029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834634496 00000100:00100000:2.0:1789130759.214129:0:25029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:2.0:1789130759.214138:0:25029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+8:2401:x1876038834634496:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789130759.214195:0:25029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.214216:0:25029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 8 pid: 25026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.214235:0:25029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789130759.214240:0:25029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789130759.214245:0:25029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.214292:0:25029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 8 pid: 25026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.214306:0:25029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 8 pid: 25026 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130759.214321:0:25029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:25029:1876038857821440:192.168.202.10@tcp:104: 00000100:00100000:2.0:1789130759.215205:0:25029:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c876a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130759.222862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.222964:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834634624 00000100:00100000:0.0:1789130759.222976:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834634624 00010000:00010000:0.0:1789130759.223018:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 9 pid: 25026 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130759.223216:0:25029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:25029:1876038857821440:192.168.202.10@tcp:104: 00010000:00010000:1.0:1789130759.223259:0:25029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130759.223937:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:0.0:1789130759.223950:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+9:2401:x1876038834634624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130759.223966:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130759.223989:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 9 pid: 25026 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.224022:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 9 pid: 25026 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.224059:0:23500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509bea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e5b expref: 9 pid: 25026 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.224075:0:23500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130759.224079:0:23500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789130759.224084:0:23500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.224094:0:23500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.224126:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130759.224195:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+8:2401:x1876038834634624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 249us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.224204:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00010000:00010000:1.0:1789130759.224271:0:25029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.224280:0:25029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.224300:0:25029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.224308:0:25029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.224316:0:25029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.224334:0:25029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353f000 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130759.224338:0:25029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.224348:0:25029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.224361:0:25029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.224369:0:25029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0121e2/0x76b2fec9b0509bf1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130759.224416:0:25029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2401:x1876038834634496:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 Request processed in 10279us (10736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130759.224424:0:25029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:1.0:1789130759.230652:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.230913:0:26319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834634880 00000100:00100000:2.0:1789130759.230925:0:26319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834634880 00000100:00100000:2.0:1789130759.231000:0:26319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:2.0:1789130759.231010:0:26319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb58730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+16:19119:x1876038834634880:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789130759.231116:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.231138:0:26319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 16 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.231149:0:26319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.231203:0:26319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 16 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.231219:0:26319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 16 pid: 23517 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130759.231234:0:26319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:26319:1876038857821568:192.168.202.10@tcp:104: 00000100:00100000:2.0:1789130759.231343:0:26319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c876a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130759.234852:0:26319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:26319:1876038857821568:192.168.202.10@tcp:104: 00010000:00010000:2.0:1789130759.234883:0:26319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130759.242154:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1789130759.242271:0:23502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834635008 00000100:00100000:2.0:1789130759.242282:0:23502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834635008 00010000:00010000:2.0:1789130759.242325:0:23502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 17 pid: 23517 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130759.242376:0:23502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:2.0:1789130759.242386:0:23502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb58703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+17:2401:x1876038834635008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130759.242402:0:23502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130759.242409:0:23502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 17 pid: 23517 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.242422:0:23502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 17 pid: 23517 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.242458:0:23502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509b42 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e1c expref: 17 pid: 23517 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.242475:0:23502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130759.242481:0:23502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e2a expref: 16 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.242491:0:23502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.242499:0:23502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.242507:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.242542:0:23502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130759.242600:0:23502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb58703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+16:2401:x1876038834635008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 215us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130759.242660:0:23502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00010000:00010000:0.0:1789130759.242729:0:26319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.242738:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.242935:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.242956:0:26319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 16 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.242965:0:26319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.242996:0:26319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 16 pid: 23515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.243008:0:26319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 16 pid: 23515 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130759.243022:0:26319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aacb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:26319:1876038857821696:192.168.202.10@tcp:104: 00000100:00100000:0.0:1789130759.243073:0:26319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cad70bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130759.246181:0:26319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aacb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:26319:1876038857821696:192.168.202.10@tcp:104: 00010000:00010000:0.0:1789130759.246218:0:26319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130759.254674:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.254746:0:23500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834635136 00000100:00100000:0.0:1789130759.254756:0:23500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834635136 00010000:00010000:0.0:1789130759.254799:0:23500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 17 pid: 23515 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130759.254842:0:23500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:0.0:1789130759.254853:0:23500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5872580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+17:2401:x1876038834635136:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130759.254867:0:23500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130759.254889:0:23500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 17 pid: 23515 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.254902:0:23500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 17 pid: 23515 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.254927:0:23500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509bc7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e46 expref: 17 pid: 23515 timeout: 878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.254942:0:23500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:0.0:1789130759.254947:0:23500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.254958:0:23500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.254965:0:23500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.254998:0:23500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130759.255058:0:23500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5872580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+16:2401:x1876038834635136:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 207us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.255067:0:23500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00010000:00010000:2.0:1789130759.256123:0:26319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.256137:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789130759.256292:0:26319:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1789130759.256419:0:26319:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1789130759.256454:0:26319:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1789130759.256535:0:26319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:26319:1876038857821824:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789130759.256594:0:26319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130759.256662:0:26319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9c876a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130759.257015:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857821824 00000100:00100000:0.0:1789130759.257032:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857821824 00000100:00100000:0.0:1789130759.257084:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789130759.257094:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:26319:x1876038857821824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789130759.257192:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:26319:x1876038857821824:12345-0@lo:1000:mdt00_003.0 Request processed in 99us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.257216:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130759.257375:0:26319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:26319:1876038857821824:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789130759.257538:0:26319:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1789130759.257588:0:26319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb5871e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:26319:1876038857821952:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789130759.257657:0:26319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130759.257669:0:26319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3ee4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130759.257778:0:23520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857821952 00000100:00100000:0.0:1789130759.257784:0:23520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857821952 00000100:00100000:0.0:1789130759.257802:0:23520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789130759.257809:0:23520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5873840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:26319:x1876038857821952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789130759.257911:0:23520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5873840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:26319:x1876038857821952:12345-0@lo:1000:mdt00_003.0 Request processed in 102us (254us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1789130759.257918:0:23520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130759.258349:0:26319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb5871e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:26319:1876038857821952:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789130759.258390:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258400:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258407:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258413:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9600 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130759.258418:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258426:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258454:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:1.0:1789130759.258457:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130759.258463:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258470:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509bff lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258499:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258507:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258513:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258527:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353fa00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:1.0:1789130759.258530:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258537:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258547:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:1.0:1789130759.258549:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130759.258555:0:26319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e2a expref: 19 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258567:0:26319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e2a expref: 19 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258577:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e2a expref: 19 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.258657:0:26319:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353ea00/0x76b2fec9b0509b5e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e2a expref: 19 pid: 23516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130759.258668:0:26319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb5870000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:26319:1876038857822080:192.168.202.10@tcp:105: 00000100:00100000:1.0:1789130759.258724:0:26319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e9cb3ee4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130759.263290:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.263393:0:23518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834635264 00000100:00100000:0.0:1789130759.263402:0:23518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834635264 00000100:00100000:0.0:1789130759.263462:0:23518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:0.0:1789130759.263473:0:23518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c9fa19050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+20:19117:x1876038834635264:12345-192.168.202.10@tcp:49:dd.0 00000100:00100000:0.0:1789130759.263600:0:23518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c9fa19050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+20:19117:x1876038834635264:12345-192.168.202.10@tcp:49:dd.0 Request processed in 129us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.263608:0:23518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:2.0:1789130759.263812:0:26319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb5870000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:26319:1876038857822080:192.168.202.10@tcp:105: 00010000:00010000:2.0:1789130759.263840:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263850:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fa00/0x76b2fec9b0509b57 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263882:0:26319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263898:0:26319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263909:0:26319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263920:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263941:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263948:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263954:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353e400 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130759.263959:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263967:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263979:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130759.263983:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130759.263986:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.263992:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353e400/0x76b2fec9b0509c06 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.264003:0:26319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.264009:0:26319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.264014:0:26319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.264020:0:26319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c8353fe00 already unused, calling callback (ffffffffc18774f0) 00010000:00010000:2.0:1789130759.264042:0:26319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.264049:0:26319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.264058:0:26319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:2.0:1789130759.264060:0:26319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789130759.264063:0:26319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130759.264069:0:26319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c8353fe00/0x76b2fec9b0509bf8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26319 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130759.264217:0:26319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb58730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+19:19119:x1876038834634880:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 33208us (33608us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1789130759.264236:0:26319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 63 00000020:00080000:2.0:1789130759.264240:0:26319:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789130759.264539:0:23551:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789130759.264543:0:23551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789130759.264559:0:23551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789130759.264565:0:23551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789130759.267502:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.267702:0:23518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834635520 00000100:00100000:0.0:1789130759.267713:0:23518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834635520 00000100:00100000:0.0:1789130759.267771:0:23518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:0.0:1789130759.267781:0:23518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+19:19119:x1876038834635520:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789130759.268126:0:23518:0:(mdd_object.c:4024:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789130759.268177:0:23518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1789130759.268216:0:23518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.268263:0:23518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.268273:0:23518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.268282:0:23518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.268289:0:23518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.268294:0:23518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.268314:0:23518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789130759.268399:0:23518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+21:19119:x1876038834635520:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 619us (905us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1789130759.268408:0:23518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000020:00080000:0.0:1789130759.268414:0:23518:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789130759.269065:0:25545:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130759.269076:0:25545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.269099:0:25545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9200 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130759.269105:0:25545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.269115:0:25545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.269133:0:25545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e9cb3e93000) 00010000:00010000:1.0:1789130759.269136:0:25545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789130759.269142:0:25545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.269148:0:25545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9200/0x76b2fec9b0509c0d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.269172:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130759.269174:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130759.269176:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130759.270019:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.270582:0:23517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834635648 00000100:00100000:0.0:1789130759.270592:0:23517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834635648 00000100:00100000:0.0:1789130759.270697:0:23517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:0.0:1789130759.270709:0:23517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5872940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+21:19117:x1876038834635648:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:0.0:1789130759.270730:0:23517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130759.270753:0:23517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509c14 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2da947ea66d14e62 expref: -99 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.270793:0:23517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509c1b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.270818:0:23517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509c1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.270830:0:23517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509c1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.270966:0:23517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9600/0x76b2fec9b0509c14 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e62 expref: 23 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.270985:0:23517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e9c829d9000/0x76b2fec9b0509c1b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x2da947ea66d14e62 expref: 22 pid: 23517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.270995:0:23517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e9cb3e93b00) 00010000:00010000:0.0:1789130759.270998:0:23517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789130759.271001:0:23517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e9c829d9000, rc 0) 00000100:00100000:0.0:1789130759.271686:0:23517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5872940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:886c6038-f10d-4040-94e2-570d1de9fb6a+22:19117:x1876038834635648:12345-192.168.202.10@tcp:101:dd.0 Request processed in 976us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130759.271696:0:23517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:2.0:1789130759.500508:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1789130759.500662:0:25032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834635776 00000100:00100000:1.0:1789130759.500675:0:25032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834635776 00000100:00100000:1.0:1789130759.500749:0:25032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:1.0:1789130759.500760:0:25032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b848d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2401:x1876038834635776:12345-192.168.202.10@tcp:4:dd.0 00002000:00010000:1.0:1789130759.500816:0:25032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa3f807, atime: 0x6aa3f806, ctime: 0x6aa3f807, blocks: 0x0 00010000:00010000:1.0:1789130759.500826:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.500844:0:25032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=778s v=(0 0) 00010000:00010000:1.0:1789130759.500868:0:25032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789130759.500877:0:25032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.500892:0:25032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130759.511264:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1789130759.511658:0:25034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789130759.511667:0:25034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789130759.515551:0:25034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038834635904 00000100:00100000:2.0:1789130759.515566:0:25034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038834635904 00000100:00100000:0.0:1789130759.518445:0:26572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:0.0:1789130759.518471:0:26572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb59970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+9:2402:x1876038834635904:12345-192.168.202.10@tcp:4:dd.0 00010000:00010000:0.0:1789130759.518522:0:26572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.518545:0:26572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130759.518550:0:26572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789130759.518565:0:26572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.518584:0:26572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.581795:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130759.599952:0:25023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1789130759.599971:0:25023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:1.0:1789130759.600209:0:25032:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1789130759.600215:0:25032:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1789130759 -> 1789130760 00002000:00010000:1.0:1789130759.600218:0:25032:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789130759 -> 1789130760 00002000:00010000:1.0:1789130759.600221:0:25032:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1789130759.600241:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.600264:0:25032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.600275:0:25032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.600283:0:25032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9b83982a00 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:1.0:1789130759.600288:0:25032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.600298:0:25032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.600319:0:25032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130759.600342:0:25032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1c98bfb/0x76b2fec9b0509c22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130759.600444:0:25032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b848d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:886c6038-f10d-4040-94e2-570d1de9fb6a+7:2401:x1876038834635776:12345-192.168.202.10@tcp:4:dd.0 Request processed in 99681us (99946us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789130759.600455:0:25032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000001:00080000:3.0:1789130759.643503:0:25023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1789130759.643880:0:26572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1789130759.643886:0:26572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1789130759.643904:0:26572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.643918:0:26572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.643927:0:26572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.643934:0:26572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e9c829d9600 already unused, calling callback (ffffffffc0c34550) 00010000:00010000:0.0:1789130759.643939:0:26572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.643948:0:26572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.643969:0:26572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130759.643988:0:26572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6aacc95/0x76b2fec9b0509c29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130759.644226:0:26572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb59970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:886c6038-f10d-4040-94e2-570d1de9fb6a+5:2402:x1876038834635904:12345-192.168.202.10@tcp:4:dd.0 Request processed in 125761us (132975us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789130759.644236:0:26572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00010000:00010000:1.0:1789130760.611972:0:23503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130760.924288:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130760.924310:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb5871a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857822208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130760.924421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130760.924831:0:25030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857822208 00000100:00100000:1.0:1789130760.924848:0:25030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857822208 00000100:00100000:1.0:1789130760.924900:0:25030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130760.924909:0:25030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857822208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130760.924932:0:25030:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1789130760.924980:0:25030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876038857822208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130760.924988:0:25030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130760.925041:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1789130760.925047:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e9b83aae940, transno 12884901892 00000004:00080000:1.0:1789130760.925064:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1789130760.925092:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb5871a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876038857822208:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789130761.430442:0:26609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789130761.625728:0:25545:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130761.945577:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857822720:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.945674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.945709:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857823232:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.945732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.945748:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876038857823744:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.945770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.945794:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789130761.945800:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb59943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857822336:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.945830:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.945857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857822848:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.945878:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.945892:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857823360:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.945911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.945953:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876038857823872:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.945973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.945995:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb5995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857822592:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946019:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.946034:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857823104:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946064:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.946087:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876038857823616:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946109:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.946145:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789130761.946151:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb5994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857822464:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.946205:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857822976:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.946255:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b841f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876038857823488:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946275:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130761.946297:0:23509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857822336 00000100:00100000:3.0:1789130761.946304:0:23509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857822336 00000100:00100000:3.0:1789130761.946343:0:23509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789130761.946353:0:23509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cbc3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3644:x1876038857822336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946425:0:23509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cbc3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e+24:3644:x1876038857822336:12345-0@lo:400:kworker.0 Request processed in 73us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130761.946433:0:23509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789130761.946465:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857822464 00000100:00100000:3.0:1789130761.946469:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857822464 00000100:00100000:3.0:1789130761.946485:0:23521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857822976 00000100:00100000:3.0:1789130761.946487:0:23521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857822976 00000100:00100000:3.0:1789130761.946499:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130761.946504:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b828221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857822464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946540:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b828221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857822464:12345-0@lo:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130761.946547:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130761.946559:0:23521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789130761.946565:0:23521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b82821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857822976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946600:0:23521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b82821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857822976:12345-0@lo:400:kworker.0 Request processed in 35us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130761.946606:0:23521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789130761.946666:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb5994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857822464:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946676:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857822976:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.946704:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb59943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1eafa3d0-ec8d-483b-8029-cb6f866d8e8e:3644:1876038857822336:0@lo:400:kworker.0 00000100:00100000:1.0:1789130761.947241:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857822720 00000100:00100000:1.0:1789130761.947254:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857822720 00000100:00100000:1.0:1789130761.947302:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857823232 00000100:00100000:1.0:1789130761.947305:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857823232 00000100:00100000:1.0:1789130761.947320:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857822592 00000100:00100000:1.0:1789130761.947322:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857822592 00000100:00100000:1.0:1789130761.947333:0:25028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857823104 00000100:00100000:1.0:1789130761.947335:0:25028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857823104 00000100:00100000:1.0:1789130761.947350:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130761.947357:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b841f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857822720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130761.947416:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b841f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857822720:12345-0@lo:400:kworker.0 Request processed in 60us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130761.947422:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130761.947435:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130761.947441:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b841f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857823232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130761.947468:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b841f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876038857823232:12345-0@lo:400:kworker.0 Request processed in 28us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130761.947473:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130761.947482:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130761.947488:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b841f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857822592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130761.947516:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b841f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876038857822592:12345-0@lo:400:kworker.0 Request processed in 29us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130761.947523:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130761.947533:0:25028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130761.947539:0:25028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b82820f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857823104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130761.947567:0:25028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b82820f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876038857823104:12345-0@lo:400:kworker.0 Request processed in 28us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130761.947573:0:25028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130761.947631:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857822720:0@lo:400:kworker.0 00000100:00100000:1.0:1789130761.947645:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876038857823232:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.947856:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb5995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876038857822592:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.947867:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876038857823104:0@lo:400:kworker.0 00000100:00100000:0.0:1789130761.948127:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857823744 00000100:00100000:0.0:1789130761.948131:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857823744 00000100:00100000:0.0:1789130761.948167:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857822848 00000100:00100000:0.0:1789130761.948171:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857822848 00000100:00100000:0.0:1789130761.948183:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857823360 00000100:00100000:0.0:1789130761.948185:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857823360 00000100:00100000:0.0:1789130761.948195:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857823872 00000100:00100000:0.0:1789130761.948198:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857823872 00000100:00100000:0.0:1789130761.948210:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857823616 00000100:00100000:0.0:1789130761.948213:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857823616 00000100:00100000:0.0:1789130761.948224:0:23516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857823488 00000100:00100000:0.0:1789130761.948227:0:23516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857823488 00000100:00100000:0.0:1789130761.948241:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789130761.948248:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b841f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876038857823744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130761.948303:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b841f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876038857823744:12345-0@lo:400:kworker.0 Request processed in 45us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130761.948310:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789130761.948324:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789130761.948330:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b841f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857822848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130761.948359:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b841f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876038857822848:12345-0@lo:400:kworker.0 Request processed in 30us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130761.948378:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789130761.948388:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789130761.948392:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b841f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857823360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130761.948412:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b841f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876038857823360:12345-0@lo:400:kworker.0 Request processed in 21us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130761.948417:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789130761.948427:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130761.948432:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b841f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876038857823872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130761.948460:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b841f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876038857823872:12345-0@lo:400:kworker.0 Request processed in 27us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130761.948465:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130761.948474:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130761.948477:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b82820780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876038857823616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130761.948495:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b82820780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876038857823616:12345-0@lo:400:kworker.0 Request processed in 18us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130761.948498:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130761.948503:0:23516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789130761.948507:0:23516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b82823c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876038857823488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130761.948526:0:23516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b82823c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876038857823488:12345-0@lo:400:kworker.0 Request processed in 18us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130761.948531:0:23516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789130761.948565:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130761.948569:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130761.948572:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130761.948574:0:23511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130761.948648:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b83aaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857824000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130761.948685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130761.948743:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876038857823488:0@lo:400:kworker.0 00010000:00080000:0.0:1789130761.948757:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b841f7840 x1876038857823616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130761.948768:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876038857823616:0@lo:400:kworker.0 00000100:00100000:2.0:1789130761.949096:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130761.949105:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857824128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130761.949145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130761.949176:0:25031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857824000 00000100:00100000:2.0:1789130761.949180:0:25031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857824000 00000100:00100000:2.0:1789130761.949204:0:25031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857824128 00000100:00100000:2.0:1789130761.949207:0:25031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857824128 00000100:00100000:2.0:1789130761.949219:0:25031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130761.949224:0:25031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9b83aaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857824000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130761.949247:0:25031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1789130761.949303:0:25031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9b83aaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857824000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130761.949309:0:25031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130761.949322:0:25031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130761.949327:0:25031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9c94510b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857824128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789130761.949342:0:25031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789130761.949376:0:25031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9c94510b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876038857824128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130761.949382:0:25031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130761.949411:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b848d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857824128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130761.949423:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b83aaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876038857824000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130761.949697:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e9cb5871a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857824256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130761.949738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130761.949772:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876038857822848:0@lo:400:kworker.0 00000100:00100000:1.0:1789130761.949783:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876038857823360:0@lo:400:kworker.0 00010000:00080000:1.0:1789130761.949795:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e9b841f6940 x1876038857823872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130761.949804:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876038857823872:0@lo:400:kworker.0 00000100:00100000:1.0:1789130761.949815:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9b841f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876038857823744:0@lo:400:kworker.0 00000100:00100000:3.0:1789130761.949949:0:25031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876038857824256 00000100:00100000:3.0:1789130761.949953:0:25031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876038857824256 00000100:00100000:3.0:1789130761.949987:0:25031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789130761.949993:0:25031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e9cb5871e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857824256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130761.950004:0:25031:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789130761.950040:0:25031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e9cb5871e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876038857824256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130761.950045:0:25031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130761.950096:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e9cb5871a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876038857824256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789130762.650161:0:23504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14337 lines, 14337 kept, 0 dropped, 0 bad.